2015-03-13 10:30:32,136 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-03-13 10:30:32,165 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-03-13 10:30:32,166 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.TrapPlatformTest
2015-03-13 10:30:32,179 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-03-13 10:30:32,719 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-03-13 10:30:32,770 INFO namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:30:32,770 INFO namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:30:32,771 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-03-13 10:30:32,772 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:30:32,775 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:30:32,776 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:32,777 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:30:32,777 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^21 = 2097152 entries
2015-03-13 10:30:32,783 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:30:32,783 INFO blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication = 3
2015-03-13 10:30:32,784 INFO blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication = 512
2015-03-13 10:30:32,785 INFO blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication = 1
2015-03-13 10:30:32,785 INFO blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams = 2
2015-03-13 10:30:32,785 INFO blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks = false
2015-03-13 10:30:32,785 INFO blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:30:32,786 INFO blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer = false
2015-03-13 10:30:32,792 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner = soberoi (auth:SIMPLE)
2015-03-13 10:30:32,792 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup = supergroup
2015-03-13 10:30:32,793 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:30:32,794 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:30:32,796 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:30:33,078 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:30:33,078 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:33,079 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:30:33,079 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^20 = 1048576 entries
2015-03-13 10:30:33,081 INFO namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:30:33,083 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:30:33,083 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:30:33,084 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension = 0
2015-03-13 10:30:33,085 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:30:33,085 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:30:33,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:30:33,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:33,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:30:33,087 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^15 = 32768 entries
2015-03-13 10:30:33,129 INFO common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1 has been successfully formatted.
2015-03-13 10:30:33,130 INFO common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2 has been successfully formatted.
2015-03-13 10:30:33,142 INFO namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:30:33,142 INFO namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:30:33,152 INFO namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:30:33,152 INFO namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:30:33,158 INFO namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(177)) - Going to retain 1 images with txid >= 0
2015-03-13 10:30:33,190 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-03-13 10:30:33,231 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(344)) - Scheduled snapshot period at 10 second(s).
2015-03-13 10:30:33,231 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:start(183)) - NameNode metrics system started
2015-03-13 10:30:33,274 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-03-13 10:30:33,311 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:33,314 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-03-13 10:30:33,314 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:33,314 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:33,324 INFO http.HttpServer (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:33,334 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52442
2015-03-13 10:30:33,334 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:33,354 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52442_hdfs____.5mg8kh/webapp
2015-03-13 10:30:33,560 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52442
2015-03-13 10:30:33,560 INFO namenode.NameNode (NameNode.java:setHttpServerAddress(439)) - Web-server up at: localhost:52442
2015-03-13 10:30:33,563 INFO namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:30:33,563 INFO namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:30:33,564 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:30:33,564 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:30:33,564 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:33,565 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:30:33,565 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^21 = 2097152 entries
2015-03-13 10:30:33,566 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:30:33,567 INFO blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication = 3
2015-03-13 10:30:33,567 INFO blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication = 512
2015-03-13 10:30:33,568 INFO blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication = 1
2015-03-13 10:30:33,568 INFO blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams = 2
2015-03-13 10:30:33,568 INFO blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks = false
2015-03-13 10:30:33,569 INFO blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:30:33,569 INFO blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer = false
2015-03-13 10:30:33,569 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner = soberoi (auth:SIMPLE)
2015-03-13 10:30:33,570 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup = supergroup
2015-03-13 10:30:33,570 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:30:33,571 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:30:33,571 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:30:33,571 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:30:33,572 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:33,572 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:30:33,572 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^20 = 1048576 entries
2015-03-13 10:30:33,573 INFO namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:30:33,574 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:30:33,574 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:30:33,574 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension = 0
2015-03-13 10:30:33,575 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:30:33,575 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:30:33,576 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:30:33,576 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:33,576 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:30:33,576 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^15 = 32768 entries
2015-03-13 10:30:33,581 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:33,584 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:33,588 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current
2015-03-13 10:30:33,588 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current
2015-03-13 10:30:33,589 INFO namenode.FSImage (FSImage.java:loadFSImage(627)) - No edit log streams selected.
2015-03-13 10:30:33,599 INFO namenode.FSImage (FSImageFormat.java:load(330)) - Loading image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 using no compression
2015-03-13 10:30:33,599 INFO namenode.FSImage (FSImageFormat.java:load(333)) - Number of files = 1
2015-03-13 10:30:33,601 INFO namenode.FSImage (FSImageFormat.java:loadFilesUnderConstruction(815)) - Number of files under construction = 0
2015-03-13 10:30:33,601 INFO namenode.FSImage (FSImageFormat.java:load(365)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 of size 199 bytes loaded in 0 seconds.
2015-03-13 10:30:33,602 INFO namenode.FSImage (FSImage.java:loadFSImage(837)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-03-13 10:30:33,606 INFO namenode.FSEditLog (FSEditLog.java:startLogSegment(1010)) - Starting log segment at 1
2015-03-13 10:30:33,657 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-03-13 10:30:33,657 INFO namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(571)) - Finished loading FSImage in 80 msecs
2015-03-13 10:30:33,772 INFO namenode.NameNode (NameNodeRpcServer.java:<init>(271)) - RPC server is binding to localhost:0
2015-03-13 10:30:33,784 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52443
2015-03-13 10:30:33,800 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(5310)) - Registered FSNamesystemState MBean
2015-03-13 10:30:33,815 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:30:33,815 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:30:33,815 INFO namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(4475)) - initializing replication queues
2015-03-13 10:30:33,823 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2316)) - Total number of blocks = 0
2015-03-13 10:30:33,823 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2317)) - Number of invalid blocks = 0
2015-03-13 10:30:33,823 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2318)) - Number of under-replicated blocks = 0
2015-03-13 10:30:33,824 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2319)) - Number of over-replicated blocks = 0
2015-03-13 10:30:33,824 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2321)) - Number of blocks being written = 0
2015-03-13 10:30:33,824 INFO hdfs.StateChange (FSNamesystem.java:initializeReplQueues(4480)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 8 msec
2015-03-13 10:30:33,824 INFO hdfs.StateChange (FSNamesystem.java:leave(4444)) - STATE* Leaving safe mode after 0 secs
2015-03-13 10:30:33,825 INFO hdfs.StateChange (FSNamesystem.java:leave(4455)) - STATE* Network topology has 0 racks and 0 datanodes
2015-03-13 10:30:33,825 INFO hdfs.StateChange (FSNamesystem.java:leave(4458)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-03-13 10:30:33,845 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:33,845 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52443: starting
2015-03-13 10:30:33,847 INFO namenode.NameNode (NameNode.java:startCommonServices(570)) - NameNode RPC up at: localhost/127.0.0.1:52443
2015-03-13 10:30:33,847 INFO namenode.FSNamesystem (FSNamesystem.java:startActiveServices(886)) - Starting services required for active state
2015-03-13 10:30:33,967 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 0 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2
2015-03-13 10:30:34,026 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,027 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,034 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52444
2015-03-13 10:30:34,037 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,039 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,040 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,041 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,041 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,042 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,044 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,044 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52445
2015-03-13 10:30:34,044 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,047 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52445_datanode____.adgh0h/webapp
2015-03-13 10:30:34,154 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52445
2015-03-13 10:30:34,162 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52446
2015-03-13 10:30:34,166 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52446
2015-03-13 10:30:34,174 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,177 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,185 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,187 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,187 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52446: starting
2015-03-13 10:30:34,194 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 1 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4
2015-03-13 10:30:34,229 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,230 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,231 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52447
2015-03-13 10:30:34,231 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,232 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,233 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,234 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,234 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,235 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,236 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,236 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52448
2015-03-13 10:30:34,236 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,253 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52448_datanode____.oxien2/webapp
2015-03-13 10:30:34,373 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,374 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1 is not formatted
2015-03-13 10:30:34,374 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,375 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,375 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2 is not formatted
2015-03-13 10:30:34,375 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,377 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52448
2015-03-13 10:30:34,378 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52450
2015-03-13 10:30:34,380 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52450
2015-03-13 10:30:34,388 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,389 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,390 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,394 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,394 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3 is not formatted
2015-03-13 10:30:34,394 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,395 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,395 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4 is not formatted
2015-03-13 10:30:34,395 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,420 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,430 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52450: starting
2015-03-13 10:30:34,439 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,440 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,440 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,440 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,441 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,441 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,441 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,441 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,443 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,450 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,451 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,451 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,451 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,452 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,452 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,452 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,452 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,454 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,456 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current
2015-03-13 10:30:34,456 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current
2015-03-13 10:30:34,457 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current
2015-03-13 10:30:34,457 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current
2015-03-13 10:30:34,461 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,461 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,466 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426281252466 with interval 21600000
2015-03-13 10:30:34,467 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426283994467 with interval 21600000
2015-03-13 10:30:34,467 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,467 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,468 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:30:34,468 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:30:34,468 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:30:34,469 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:30:34,480 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 12ms
2015-03-13 10:30:34,480 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 12ms
2015-03-13 10:30:34,480 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 12ms
2015-03-13 10:30:34,480 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 11ms
2015-03-13 10:30:34,481 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 14ms
2015-03-13 10:30:34,481 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:30:34,481 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 14ms
2015-03-13 10:30:34,481 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 0ms
2015-03-13 10:30:34,482 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:30:34,481 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:30:34,482 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 0ms
2015-03-13 10:30:34,482 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:30:34,482 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 0ms
2015-03-13 10:30:34,482 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:30:34,483 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 0ms
2015-03-13 10:30:34,483 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 2ms
2015-03-13 10:30:34,484 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 2 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6
2015-03-13 10:30:34,484 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,484 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,494 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-218115309-10.1.1.144-52444-1426267834377
2015-03-13 10:30:34,496 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52444
2015-03-13 10:30:34,497 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-898105819-10.1.1.144-52447-1426267834396, infoPort=52448, ipcPort=52450, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-898105819-10.1.1.144-52447-1426267834396
2015-03-13 10:30:34,497 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52447
2015-03-13 10:30:34,500 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,500 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,500 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,500 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,512 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,512 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,513 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52451
2015-03-13 10:30:34,513 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,515 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,516 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,517 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,517 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,518 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,519 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,519 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52452
2015-03-13 10:30:34,519 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,523 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52452_datanode____.46eex1/webapp
2015-03-13 10:30:34,545 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,545 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,545 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,545 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,557 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52447 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,557 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52444 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,557 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-898105819-10.1.1.144-52447-1426267834396, infoPort=52448, ipcPort=52450, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:30:34,558 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:30:34,575 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 2 msec to generate and 28 msecs for RPC and NN processing
2015-03-13 10:30:34,576 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@19bf8e26
2015-03-13 10:30:34,576 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 30 msecs for RPC and NN processing
2015-03-13 10:30:34,576 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@6f0d6dfe
2015-03-13 10:30:34,579 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,579 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:34,579 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,579 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,579 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:34,580 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,580 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:30:34,579 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:30:34,580 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,580 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,583 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:34,584 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:34,648 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52452
2015-03-13 10:30:34,649 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52453
2015-03-13 10:30:34,652 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52453
2015-03-13 10:30:34,656 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,657 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,658 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,658 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,659 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52453: starting
2015-03-13 10:30:34,661 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 3 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8
2015-03-13 10:30:34,661 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,662 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5 is not formatted
2015-03-13 10:30:34,662 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,663 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,663 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6 is not formatted
2015-03-13 10:30:34,664 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,689 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,689 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,690 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52454
2015-03-13 10:30:34,690 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,692 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,693 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,693 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,694 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,695 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,696 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,696 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52455
2015-03-13 10:30:34,696 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,701 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52455_datanode____.iqgcjm/webapp
2015-03-13 10:30:34,706 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,707 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,707 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,707 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,708 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,708 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,708 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,708 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,709 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,710 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current
2015-03-13 10:30:34,710 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current
2015-03-13 10:30:34,710 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,712 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426268648712 with interval 21600000
2015-03-13 10:30:34,712 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,713 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:30:34,713 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:30:34,719 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 6ms
2015-03-13 10:30:34,719 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 6ms
2015-03-13 10:30:34,719 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 6ms
2015-03-13 10:30:34,719 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:30:34,720 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 0ms
2015-03-13 10:30:34,720 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:30:34,720 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 0ms
2015-03-13 10:30:34,720 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:30:34,720 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,721 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-79468681-10.1.1.144-52451-1426267834665
2015-03-13 10:30:34,722 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52451
2015-03-13 10:30:34,723 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,723 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,724 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,724 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,725 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52451 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,726 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:30:34,726 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 1 msecs for RPC and NN processing
2015-03-13 10:30:34,726 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@28312cbb
2015-03-13 10:30:34,727 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,727 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:34,727 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,727 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:30:34,727 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,728 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:34,809 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52455
2015-03-13 10:30:34,810 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52456
2015-03-13 10:30:34,813 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52456
2015-03-13 10:30:34,817 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,818 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,819 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,819 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,819 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52456: starting
2015-03-13 10:30:34,822 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,822 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7 is not formatted
2015-03-13 10:30:34,822 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,823 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,823 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8 is not formatted
2015-03-13 10:30:34,823 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,861 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,862 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,862 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,862 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,863 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,863 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,863 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,863 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,865 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,865 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current
2015-03-13 10:30:34,865 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current
2015-03-13 10:30:34,866 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,867 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426273383867 with interval 21600000
2015-03-13 10:30:34,867 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,868 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:30:34,868 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:30:34,875 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 7ms
2015-03-13 10:30:34,875 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 7ms
2015-03-13 10:30:34,875 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 8ms
2015-03-13 10:30:34,875 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:30:34,875 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 0ms
2015-03-13 10:30:34,875 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:30:34,876 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 1ms
2015-03-13 10:30:34,876 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:30:34,876 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,877 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-1285499800-10.1.1.144-52454-1426267834827
2015-03-13 10:30:34,877 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52454
2015-03-13 10:30:34,878 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,878 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,879 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,880 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,881 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52454 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,881 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:30:34,882 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:30:34,882 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@1a1d2fe0
2015-03-13 10:30:34,882 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,882 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:30:34,882 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,883 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:30:34,883 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,883 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:35,121 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(1891)) - Cluster is active
2015-03-13 10:30:35,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:35,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:35,180 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:35,206 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001 src: /127.0.0.1:52458 dest: /127.0.0.1:52444
2015-03-13 10:30:35,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001 src: /127.0.0.1:52459 dest: /127.0.0.1:52454
2015-03-13 10:30:35,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001 src: /127.0.0.1:52460 dest: /127.0.0.1:52451
2015-03-13 10:30:35,232 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52460, dest: /127.0.0.1:52451, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 6480000
2015-03-13 10:30:35,232 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:35,232 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:35,233 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52459, dest: /127.0.0.1:52454, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 9241000
2015-03-13 10:30:35,234 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,234 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52458, dest: /127.0.0.1:52444, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 10180000
2015-03-13 10:30:35,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:35,235 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:35,238 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:35,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:30:35,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:35,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:35,344 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:35,346 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002 src: /127.0.0.1:52461 dest: /127.0.0.1:52447
2015-03-13 10:30:35,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002 src: /127.0.0.1:52462 dest: /127.0.0.1:52444
2015-03-13 10:30:35,349 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002 src: /127.0.0.1:52463 dest: /127.0.0.1:52454
2015-03-13 10:30:35,354 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52463, dest: /127.0.0.1:52454, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 4505000
2015-03-13 10:30:35,355 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:35,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:35,356 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52462, dest: /127.0.0.1:52444, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 5500000
2015-03-13 10:30:35,356 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,356 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:35,357 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52461, dest: /127.0.0.1:52447, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 6358000
2015-03-13 10:30:35,357 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,357 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:35,359 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:35,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:30:35,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging dst=null perm=null
2015-03-13 10:30:35,638 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(150)) - mkdir: hdfs://localhost:52443/tmp/hadoop-yarn/staging
2015-03-13 10:30:35,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:35,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:35,678 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:30:35,684 INFO security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(75)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-03-13 10:30:35,687 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(77)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-03-13 10:30:35,688 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-03-13 10:30:35,690 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-03-13 10:30:35,690 INFO resourcemanager.ResourceManager (ResourceManager.java:createScheduler(328)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
2015-03-13 10:30:35,717 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-03-13 10:30:35,718 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-03-13 10:30:35,718 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-03-13 10:30:35,719 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-03-13 10:30:35,730 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - ResourceManager metrics system started (again)
2015-03-13 10:30:35,759 INFO capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(189)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:*
2015-03-13 10:30:35,759 INFO capacity.ParentQueue (ParentQueue.java:<init>(151)) - Initialized parent-queue root name=root, fullname=root
2015-03-13 10:30:35,765 INFO capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(271)) - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:* [= configuredAcls ]
nodeLocalityDelay = 0
2015-03-13 10:30:35,766 INFO capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:30:35,766 INFO capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:30:35,767 INFO capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(307)) - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:30:35,767 INFO capacity.CapacityScheduler (CapacityScheduler.java:reinitialize(271)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>
2015-03-13 10:30:35,812 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-03-13 10:30:35,817 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-03-13 10:30:35,818 INFO resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-03-13 10:30:35,819 INFO util.HostsFileReader (HostsFileReader.java:refresh(84)) - Refreshing hosts (include/exclude) list
2015-03-13 10:30:35,820 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(225)) - Waiting for RM to start...
2015-03-13 10:30:35,821 INFO security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(103)) - Rolling master-key for container-tokens
2015-03-13 10:30:35,821 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:30:35,823 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(97)) - Rolling master-key for nm-tokens
2015-03-13 10:30:35,830 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:35,830 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-03-13 10:30:35,830 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:35,830 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:35,831 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /cluster/*
2015-03-13 10:30:35,831 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:35,832 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52464
2015-03-13 10:30:35,832 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:35,835 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52464_cluster____.akgizd/webapp
2015-03-13 10:30:35,889 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52464
2015-03-13 10:30:35,889 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /cluster started at 52464
2015-03-13 10:30:36,086 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:36,087 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:36,087 INFO security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 1
2015-03-13 10:30:36,088 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:30:36,089 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:36,089 INFO security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 2
2015-03-13 10:30:36,098 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52465
2015-03-13 10:30:36,100 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-03-13 10:30:36,100 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,100 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52465: starting
2015-03-13 10:30:36,111 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52466
2015-03-13 10:30:36,113 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-03-13 10:30:36,114 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,114 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52466: starting
2015-03-13 10:30:36,134 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52467
2015-03-13 10:30:36,136 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-03-13 10:30:36,136 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,136 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52467: starting
2015-03-13 10:30:36,153 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52468
2015-03-13 10:30:36,155 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-03-13 10:30:36,155 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,155 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52468: starting
2015-03-13 10:30:37,326 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(238)) - MiniYARN ResourceManager address: 10.1.1.144:52467
2015-03-13 10:30:37,326 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(240)) - MiniYARN ResourceManager web address: Edinburgh.local:52464
2015-03-13 10:30:37,327 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-03-13 10:30:37,327 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-03-13 10:30:37,328 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-03-13 10:30:37,328 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-03-13 10:30:37,338 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-03-13 10:30:37,339 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-03-13 10:30:37,339 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-03-13 10:30:37,339 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-03-13 10:30:37,339 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 0
2015-03-13 10:30:37,375 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:37,376 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:37,376 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:37,377 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:37,377 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:37,377 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:37,378 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:37,379 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:37,379 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:37,384 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:37,384 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:37,522 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:37,535 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:37,535 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:37,552 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:30:37,552 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:37,552 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:37,553 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:37,553 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:37,554 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 0 to start...
2015-03-13 10:30:37,564 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52469
2015-03-13 10:30:37,566 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:37,567 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:37,568 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:37,568 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52469: starting
2015-03-13 10:30:37,574 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52469
2015-03-13 10:30:37,574 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52469
2015-03-13 10:30:37,581 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52470
2015-03-13 10:30:37,584 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:37,584 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:37,584 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52470: starting
2015-03-13 10:30:37,586 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52470
2015-03-13 10:30:37,594 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:37,602 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52471
2015-03-13 10:30:37,603 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:37,603 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:37,604 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:37,604 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:37,604 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:37,604 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:37,605 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:37,605 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:37,606 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52472
2015-03-13 10:30:37,606 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:37,608 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52472_node____gd9cs8/webapp
2015-03-13 10:30:38,458 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52472
2015-03-13 10:30:38,459 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52472
2015-03-13 10:30:38,480 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:38,494 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:38,496 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52469 httpPort: 52472) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52469
2015-03-13 10:30:38,496 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:38,497 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:38,497 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52469 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:38,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:38,499 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52469 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:38,501 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52469 clusterResource: <memory:4096, vCores:8>
2015-03-13 10:30:38,559 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-03-13 10:30:38,560 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-03-13 10:30:38,560 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-03-13 10:30:38,560 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-03-13 10:30:38,575 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-03-13 10:30:38,576 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-03-13 10:30:38,576 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-03-13 10:30:38,576 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-03-13 10:30:38,577 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 1
2015-03-13 10:30:38,592 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:38,592 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:38,593 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:38,593 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:38,593 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:38,593 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:38,593 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:38,594 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:38,594 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:38,595 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:38,596 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:38,709 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:38,711 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:38,711 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:38,714 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:30:38,715 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:38,715 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:38,715 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:38,716 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:38,716 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 1 to start...
2015-03-13 10:30:38,719 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52473
2015-03-13 10:30:38,722 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:38,722 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:38,723 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:38,723 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52473: starting
2015-03-13 10:30:38,727 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52473
2015-03-13 10:30:38,727 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52473
2015-03-13 10:30:38,728 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52474
2015-03-13 10:30:38,731 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:38,731 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:38,731 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52474: starting
2015-03-13 10:30:38,733 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52474
2015-03-13 10:30:38,735 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:38,736 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52475
2015-03-13 10:30:38,736 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:38,738 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:38,738 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:38,739 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:38,739 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:38,739 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:38,740 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:38,740 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:38,740 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52476
2015-03-13 10:30:38,740 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:38,743 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52476_node____.w62oec/webapp
2015-03-13 10:30:38,981 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52476
2015-03-13 10:30:38,982 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52476
2015-03-13 10:30:38,988 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:38,990 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:38,990 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52473 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:38,990 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52473 httpPort: 52476) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52473
2015-03-13 10:30:38,990 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52473 clusterResource: <memory:8192, vCores:16>
2015-03-13 10:30:38,990 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:38,990 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:38,991 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52473 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:38,991 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:39,473 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002
2015-03-13 10:30:39,475 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001
2015-03-13 10:30:39,481 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002
2015-03-13 10:30:39,721 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-03-13 10:30:39,721 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-03-13 10:30:39,722 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-03-13 10:30:39,722 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-03-13 10:30:39,723 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001
2015-03-13 10:30:39,732 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-03-13 10:30:39,732 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-03-13 10:30:39,732 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-03-13 10:30:39,732 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-03-13 10:30:39,733 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 2
2015-03-13 10:30:39,742 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:39,742 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:39,742 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:39,743 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:39,743 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:39,743 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:39,743 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:39,744 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:39,744 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:39,746 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:39,746 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:39,850 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:39,851 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:39,851 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:39,853 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:30:39,853 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:39,854 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:39,854 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:39,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:39,854 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 2 to start...
2015-03-13 10:30:39,859 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52477
2015-03-13 10:30:39,862 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:39,862 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:39,862 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:39,862 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52477: starting
2015-03-13 10:30:39,866 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52477
2015-03-13 10:30:39,866 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52477
2015-03-13 10:30:39,867 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52478
2015-03-13 10:30:39,869 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:39,870 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:39,870 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52478: starting
2015-03-13 10:30:39,872 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002
2015-03-13 10:30:39,873 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52478
2015-03-13 10:30:39,874 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:39,875 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52479
2015-03-13 10:30:39,876 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:39,876 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:39,877 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:39,877 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:39,877 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:39,877 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:39,878 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:39,878 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001
2015-03-13 10:30:39,878 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:39,879 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52480
2015-03-13 10:30:39,879 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:39,882 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52480_node____1vddlh/webapp
2015-03-13 10:30:40,058 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52480
2015-03-13 10:30:40,059 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52480
2015-03-13 10:30:40,066 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:40,067 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:40,067 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52477 httpPort: 52480) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52477
2015-03-13 10:30:40,067 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52477 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:40,067 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:40,068 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:40,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52477 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:40,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:40,068 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52477 clusterResource: <memory:12288, vCores:24>
2015-03-13 10:30:40,859 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-03-13 10:30:40,860 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-03-13 10:30:40,860 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-03-13 10:30:40,860 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-03-13 10:30:40,873 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-03-13 10:30:40,873 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-03-13 10:30:40,874 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-03-13 10:30:40,874 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-03-13 10:30:40,874 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 3
2015-03-13 10:30:40,887 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:40,888 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:40,888 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:40,888 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:40,888 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:40,889 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:40,889 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:40,889 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:40,889 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:40,892 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:40,892 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:40,994 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:40,995 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:40,995 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:40,998 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:30:40,998 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:40,998 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:40,998 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:40,999 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:40,999 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 3 to start...
2015-03-13 10:30:41,001 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52481
2015-03-13 10:30:41,003 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:41,003 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:41,004 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:41,004 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52481: starting
2015-03-13 10:30:41,007 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52481
2015-03-13 10:30:41,008 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52481
2015-03-13 10:30:41,009 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52482
2015-03-13 10:30:41,010 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:41,011 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:41,011 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52482: starting
2015-03-13 10:30:41,013 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52482
2015-03-13 10:30:41,013 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:41,014 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52483
2015-03-13 10:30:41,014 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:41,015 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:41,015 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:41,016 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:41,016 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:41,016 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:41,017 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:41,017 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:41,017 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52484
2015-03-13 10:30:41,017 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:41,020 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52484_node____od5ee1/webapp
2015-03-13 10:30:41,233 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52484
2015-03-13 10:30:41,233 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52484
2015-03-13 10:30:41,240 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:41,241 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:41,241 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52481 httpPort: 52484) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52481
2015-03-13 10:30:41,241 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52481 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:41,241 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:41,241 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:41,241 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52481 clusterResource: <memory:16384, vCores:32>
2015-03-13 10:30:41,241 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52481 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:41,241 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:42,010 INFO hs.JobHistory (JobHistory.java:serviceInit(77)) - JobHistory Init
2015-03-13 10:30:42,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null
2015-03-13 10:30:42,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:30:42,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:42,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:30:42,026 INFO hs.HistoryFileManager (HistoryFileManager.java:mkdir(561)) - Perms after creating 511, Expected: 1023
2015-03-13 10:30:42,026 INFO hs.HistoryFileManager (HistoryFileManager.java:mkdir(564)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-03-13 10:30:42,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=soberoi:supergroup:rwxrwxrwt
2015-03-13 10:30:42,030 INFO hs.HistoryFileManager (HistoryFileManager.java:initExisting(580)) - Initializing Existing Jobs...
2015-03-13 10:30:42,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null
2015-03-13 10:30:42,035 INFO hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(65)) - CachedHistoryStorage Init
2015-03-13 10:30:42,036 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(207)) - Waiting for HistoryServer to start...
2015-03-13 10:30:42,036 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - JobHistoryServer metrics system started (again)
2015-03-13 10:30:42,036 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:42,037 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:30:42,037 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:42,040 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:42,040 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-03-13 10:30:42,040 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:42,040 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:42,041 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /jobhistory/*
2015-03-13 10:30:42,041 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:42,041 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52485
2015-03-13 10:30:42,041 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:42,044 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52485_jobhistory____.umkp2z/webapp
2015-03-13 10:30:42,209 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52485
2015-03-13 10:30:42,209 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /jobhistory started at 52485
2015-03-13 10:30:42,228 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:42,235 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52486
2015-03-13 10:30:42,236 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-03-13 10:30:42,237 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:42,237 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 52486: starting
2015-03-13 10:30:42,239 INFO hs.HistoryClientService (HistoryClientService.java:serviceStart(140)) - Instantiated MRClientService at 10.1.1.144/10.1.1.144:52486
2015-03-13 10:30:43,541 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(224)) - MiniMRYARN ResourceManager address: 10.1.1.144:52467
2015-03-13 10:30:43,542 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(226)) - MiniMRYARN ResourceManager web address: Edinburgh.local:52464
2015-03-13 10:30:43,542 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(228)) - MiniMRYARN HistoryServer address: 10.1.1.144:52486
2015-03-13 10:30:43,543 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(230)) - MiniMRYARN HistoryServer web address: Edinburgh.local:52485
2015-03-13 10:30:43,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:43,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:43,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,561 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt. BP-1641873285-10.1.1.144-1426267833098 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:30:43,563 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003 src: /127.0.0.1:52487 dest: /127.0.0.1:52451
2015-03-13 10:30:43,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003 src: /127.0.0.1:52488 dest: /127.0.0.1:52454
2015-03-13 10:30:43,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003 src: /127.0.0.1:52489 dest: /127.0.0.1:52444
2015-03-13 10:30:43,570 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52489, dest: /127.0.0.1:52444, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 3494000
2015-03-13 10:30:43,570 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,571 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:30:43,571 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52488, dest: /127.0.0.1:52454, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 4649000
2015-03-13 10:30:43,572 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,573 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:30:43,573 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52487, dest: /127.0.0.1:52451, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 6039000
2015-03-13 10:30:43,574 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,575 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:30:43,577 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
2015-03-13 10:30:43,604 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-03-13 10:30:43,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-03-13 10:30:43,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-03-13 10:30:43,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:30:43,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-03-13 10:30:43,605 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
2015-03-13 10:30:43,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-03-13 10:30:43,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-03-13 10:30:43,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-03-13 10:30:43,606 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-03-13 10:30:43,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-03-13 10:30:43,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-03-13 10:30:43,607 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-03-13 10:30:43,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-03-13 10:30:43,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-03-13 10:30:43,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-03-13 10:30:43,613 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:30:43,613 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:30:43,619 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 3066BE8105C74D4DAC7086700201E39F
2015-03-13 10:30:43,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-03-13 10:30:43,668 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-03-13 10:30:43,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:30:43,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:30:43,726 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-03-13 10:30:43,728 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:30:43,728 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:30:43,728 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap"]
2015-03-13 10:30:43,729 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:30:43,729 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 2
2015-03-13 10:30:43,729 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 2
2015-03-13 10:30:43,730 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/2)
2015-03-13 10:30:43,771 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:30:43,784 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:30:43,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:30:43,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:30:43,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:30:43,817 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 1
2015-03-13 10:30:43,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001 dst=null perm=null
2015-03-13 10:30:43,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:30:43,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:30:43,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:43,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,833 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:43,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52491 dest: /127.0.0.1:52451
2015-03-13 10:30:43,837 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52492 dest: /127.0.0.1:52444
2015-03-13 10:30:43,838 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52493 dest: /127.0.0.1:52454
2015-03-13 10:30:43,844 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52493, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 4753000
2015-03-13 10:30:43,845 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:43,846 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52492, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 5694000
2015-03-13 10:30:43,846 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:43,847 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52491, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 7043000
2015-03-13 10:30:43,848 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,849 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:43,850 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,852 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar
2015-03-13 10:30:43,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:43,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:43,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:43,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:43,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:30:43,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:30:43,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:30:43,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:30:43,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:30:43,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:43,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-03-13 10:30:43,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:43,876 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:30:43,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:43,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,890 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split
2015-03-13 10:30:43,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:43,894 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:43,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52494 dest: /127.0.0.1:52454
2015-03-13 10:30:43,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52495 dest: /127.0.0.1:52447
2015-03-13 10:30:43,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52496 dest: /127.0.0.1:52444
2015-03-13 10:30:43,900 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52497 dest: /127.0.0.1:52451
2015-03-13 10:30:43,905 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52497, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 3696000
2015-03-13 10:30:43,906 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,907 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,907 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52496, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 6031000
2015-03-13 10:30:43,908 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,911 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52495, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 8828000
2015-03-13 10:30:43,911 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,914 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,914 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52494, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 12310000
2015-03-13 10:30:43,914 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,915 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,917 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,925 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:43,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006 src: /127.0.0.1:52498 dest: /127.0.0.1:52454
2015-03-13 10:30:43,927 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006 src: /127.0.0.1:52499 dest: /127.0.0.1:52444
2015-03-13 10:30:43,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006 src: /127.0.0.1:52500 dest: /127.0.0.1:52451
2015-03-13 10:30:43,933 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52500, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 2864000
2015-03-13 10:30:43,933 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,934 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,935 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52499, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 4253000
2015-03-13 10:30:43,935 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,936 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,936 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52498, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 5524000
2015-03-13 10:30:43,936 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,938 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,939 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,939 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:30:43,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-03-13 10:30:43,949 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-03-13 10:30:43,950 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
2015-03-13 10:30:43,951 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:30:43,952 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-03-13 10:30:43,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-03-13 10:30:43,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-03-13 10:30:43,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-03-13 10:30:43,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-03-13 10:30:43,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-03-13 10:30:43,953 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-03-13 10:30:43,954 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-03-13 10:30:43,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-03-13 10:30:43,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-03-13 10:30:43,955 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-03-13 10:30:43,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-03-13 10:30:43,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-03-13 10:30:43,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-03-13 10:30:43,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-03-13 10:30:43,956 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-03-13 10:30:43,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-03-13 10:30:43,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:30:43,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-03-13 10:30:43,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-03-13 10:30:43,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-03-13 10:30:43,957 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-03-13 10:30:43,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-03-13 10:30:43,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-03-13 10:30:43,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-03-13 10:30:43,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-03-13 10:30:43,958 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-03-13 10:30:43,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-03-13 10:30:43,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-03-13 10:30:43,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-03-13 10:30:43,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-03-13 10:30:43,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-03-13 10:30:43,959 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-03-13 10:30:43,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-03-13 10:30:43,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-03-13 10:30:43,962 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-03-13 10:30:43,963 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-03-13 10:30:43,964 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-03-13 10:30:43,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-03-13 10:30:43,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
2015-03-13 10:30:43,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-03-13 10:30:43,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-03-13 10:30:43,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-03-13 10:30:43,965 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-03-13 10:30:43,966 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-03-13 10:30:43,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-03-13 10:30:43,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-03-13 10:30:43,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:30:43,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-03-13 10:30:43,967 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-03-13 10:30:44,061 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:30:44,063 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007 src: /127.0.0.1:52501 dest: /127.0.0.1:52444
2015-03-13 10:30:44,064 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007 src: /127.0.0.1:52502 dest: /127.0.0.1:52451
2015-03-13 10:30:44,066 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007 src: /127.0.0.1:52503 dest: /127.0.0.1:52447
2015-03-13 10:30:44,077 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52503, dest: /127.0.0.1:52447, bytes: 98290, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 9870000
2015-03-13 10:30:44,078 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:44,079 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:30:44,080 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52502, dest: /127.0.0.1:52451, bytes: 98290, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 11734000
2015-03-13 10:30:44,080 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:44,081 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:30:44,082 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52501, dest: /127.0.0.1:52444, bytes: 98290, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 13741000
2015-03-13 10:30:44,082 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:44,082 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:30:44,085 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:44,085 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0001
2015-03-13 10:30:44,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001 dst=null perm=null
2015-03-13 10:30:44,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:44,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:44,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:44,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:44,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:44,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:44,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:44,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:44,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,188 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 1 submitted by user soberoi
2015-03-13 10:30:44,188 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0001
2015-03-13 10:30:44,189 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from NEW to NEW_SAVING
2015-03-13 10:30:44,189 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0001
2015-03-13 10:30:44,193 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0001
2015-03-13 10:30:44,195 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:30:44,195 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,198 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from NEW to SUBMITTED
2015-03-13 10:30:44,202 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0001 from user: soberoi activated in queue: default
2015-03-13 10:30:44,204 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:30:44,204 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:30:44,204 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0001_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0, currently active: 1
2015-03-13 10:30:44,207 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:30:44,207 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from SUBMITTED to ACCEPTED
2015-03-13 10:30:44,209 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0001 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:30:44,231 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0001/
2015-03-13 10:30:44,232 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0001
2015-03-13 10:30:44,232 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0001/
2015-03-13 10:30:44,270 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:44,270 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:30:44,270 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:30:44,270 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0001_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:44,271 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:30:44,271 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:44,272 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:44,273 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0001 AttemptId: appattempt_1426267835672_0001_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:30:44,273 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:30:44,277 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,278 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:30:44,280 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0001_000001
2015-03-13 10:30:44,289 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,289 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:30:44,307 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:30:44,314 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000001 by user soberoi
2015-03-13 10:30:44,324 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0001
2015-03-13 10:30:44,326 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from NEW to INITING
2015-03-13 10:30:44,326 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:30:44,327 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000001 to application application_1426267835672_0001
2015-03-13 10:30:44,330 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from INITING to RUNNING
2015-03-13 10:30:44,332 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:30:44,332 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:44,335 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,335 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:30:44,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,341 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000001
2015-03-13 10:30:44,342 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:44,348 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:44,357 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0001_01_000001.tokens. Credentials list:
2015-03-13 10:30:44,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:30:44,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:30:44,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:30:44,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:30:44,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:30:44,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:30:44,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:30:44,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:30:44,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:30:44,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:30:44,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:44,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:44,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:44,407 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52505, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 3220000
2015-03-13 10:30:44,407 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52506, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 3702000
2015-03-13 10:30:44,459 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,461 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:44,480 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007
2015-03-13 10:30:44,487 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003
2015-03-13 10:30:44,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006
2015-03-13 10:30:44,489 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:44,490 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:44,491 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007
2015-03-13 10:30:44,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001.tokens
2015-03-13 10:30:44,496 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:44,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:44,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:44,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:44,597 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52509, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 692000
2015-03-13 10:30:44,629 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:44,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:44,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:44,655 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52506, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 220000
2015-03-13 10:30:44,668 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:44,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:44,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:44,695 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52506, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 223000
2015-03-13 10:30:44,707 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:44,725 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003
2015-03-13 10:30:44,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:44,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:44,727 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:44,728 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007
2015-03-13 10:30:44,728 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:44,729 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006
2015-03-13 10:30:44,734 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52509, bytes: 99058, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 382000
2015-03-13 10:30:44,747 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,748 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:44,783 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:44,783 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:44,853 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001/default_container_executor.sh]
2015-03-13 10:30:44,886 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:44,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003
2015-03-13 10:30:44,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006
2015-03-13 10:30:44,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:45,266 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:45,268 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:45,845 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52451 to replicate blk_1073741828_1004 to datanode(s) 127.0.0.1:52447
2015-03-13 10:30:46,268 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:46,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:30:46,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_STARTED dst=null perm=null
2015-03-13 10:30:46,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:30:46,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_FAIL dst=null perm=null
2015-03-13 10:30:46,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001 dst=null perm=null
2015-03-13 10:30:46,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:30:46,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:30:46,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:30:46,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:30:46,736 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 to 127.0.0.1:52447
2015-03-13 10:30:46,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52511 dest: /127.0.0.1:52447
2015-03-13 10:30:46,740 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:30:46,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52511 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:30:46,742 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741828_1004 size 254067
2015-03-13 10:30:46,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:46,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:30:46,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52512, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 248000
2015-03-13 10:30:47,269 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:47,605 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:30:47,610 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0001_000001
2015-03-13 10:30:47,611 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0001 APPATTEMPTID=appattempt_1426267835672_0001_000001
2015-03-13 10:30:47,612 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:30:47,612 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from ACCEPTED to RUNNING
2015-03-13 10:30:47,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:47,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:47,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:47,847 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:47,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008 src: /127.0.0.1:52518 dest: /127.0.0.1:52447
2015-03-13 10:30:47,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008 src: /127.0.0.1:52519 dest: /127.0.0.1:52451
2015-03-13 10:30:47,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008 src: /127.0.0.1:52520 dest: /127.0.0.1:52454
2015-03-13 10:30:47,916 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52520, dest: /127.0.0.1:52454, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 12757000
2015-03-13 10:30:47,916 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:47,917 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52519, dest: /127.0.0.1:52451, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 13085000
2015-03-13 10:30:47,918 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:47,917 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:47,919 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52518, dest: /127.0.0.1:52447, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 15287000
2015-03-13 10:30:47,919 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:47,920 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:47,920 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:47,925 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:30:48,275 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:49,023 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,023 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:49,023 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:30:49,024 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,024 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:30:49,024 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,025 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,026 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:49,026 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:30:49,026 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,026 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:30:49,026 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,027 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,027 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:49,027 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:30:49,028 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,028 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:30:49,028 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,028 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,029 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:49,029 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:30:49,029 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,029 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:30:49,029 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,276 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:49,485 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008
2015-03-13 10:30:49,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:49,662 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,663 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,663 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,664 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:49,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:49,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:49,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:49,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,735 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008
2015-03-13 10:30:49,773 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:30:49,777 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000005 by user soberoi
2015-03-13 10:30:49,777 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000002 by user soberoi
2015-03-13 10:30:49,777 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000003 by user soberoi
2015-03-13 10:30:49,777 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000004 by user soberoi
2015-03-13 10:30:49,779 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:49,778 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000002 to application application_1426267835672_0001
2015-03-13 10:30:49,778 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:49,778 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0001
2015-03-13 10:30:49,780 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000003 to application application_1426267835672_0001
2015-03-13 10:30:49,779 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:49,781 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000004 to application application_1426267835672_0001
2015-03-13 10:30:49,782 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from NEW to INITING
2015-03-13 10:30:49,782 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000005 to application application_1426267835672_0001
2015-03-13 10:30:49,781 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:49,783 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from INITING to RUNNING
2015-03-13 10:30:49,783 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,784 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,785 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,785 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,785 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,786 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,786 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,787 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,788 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,788 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,788 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,789 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,789 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,789 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,789 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,789 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,790 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,790 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,790 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,790 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,790 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000004
2015-03-13 10:30:49,791 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,794 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,795 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000003
2015-03-13 10:30:49,796 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,796 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,796 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000005
2015-03-13 10:30:49,797 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,797 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,797 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000002
2015-03-13 10:30:49,798 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,798 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,815 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0001_01_000004.tokens. Credentials list:
2015-03-13 10:30:49,816 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0001_01_000003.tokens. Credentials list:
2015-03-13 10:30:49,816 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000002.tokens. Credentials list:
2015-03-13 10:30:49,818 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000005.tokens. Credentials list:
2015-03-13 10:30:49,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:30:49,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:30:49,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:30:49,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:30:49,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:30:49,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:30:49,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:30:49,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:30:49,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:30:49,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:30:49,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:30:49,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:30:49,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:49,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52522, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 1903000
2015-03-13 10:30:49,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52523, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 2054000
2015-03-13 10:30:49,879 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:49,879 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:49,890 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008
2015-03-13 10:30:49,927 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004.tokens
2015-03-13 10:30:49,927 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:49,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:49,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:49,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar dst=null perm=null
2015-03-13 10:30:50,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52523, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1260990858_967, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 707000
2015-03-13 10:30:50,023 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,024 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,026 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,026 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:50,027 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,028 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,028 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,030 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:50,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:50,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml dst=null perm=null
2015-03-13 10:30:50,055 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52523, bytes: 99058, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1260990858_967, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 372000
2015-03-13 10:30:50,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:50,069 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,070 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,070 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,070 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,119 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,120 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,121 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,121 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,121 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,121 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,128 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,128 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003/default_container_executor.sh]
2015-03-13 10:30:50,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005/default_container_executor.sh]
2015-03-13 10:30:50,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002/default_container_executor.sh]
2015-03-13 10:30:50,249 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004/default_container_executor.sh]
2015-03-13 10:30:50,279 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,679 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:30:51,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,029 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,099 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:51,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005.tokens
2015-03-13 10:30:51,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:51,283 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:51,455 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002.tokens
2015-03-13 10:30:51,455 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:51,576 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:51,692 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003.tokens
2015-03-13 10:30:51,692 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:52,037 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,042 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,042 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,043 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,043 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,291 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,046 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,046 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,049 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,050 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,050 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,050 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,294 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,055 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,055 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,055 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:57,003 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52534, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 291000
2015-03-13 10:30:57,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:57,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:57,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split dst=null perm=null
2015-03-13 10:30:57,059 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,060 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,060 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:57,144 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52538, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000002_0_-219719247_1, offset: 512, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 292000
2015-03-13 10:30:57,163 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52539, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000003_0_-1508680245_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 307000
2015-03-13 10:30:57,168 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52540, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000000_0_1872241169_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 231000
2015-03-13 10:30:57,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:57,248 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52541, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000002_0_-219719247_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 292000
2015-03-13 10:30:57,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:57,263 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52542, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000003_0_-1508680245_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 214000
2015-03-13 10:30:57,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:30:57,273 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52543, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000000_0_1872241169_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1827000
2015-03-13 10:30:57,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,543 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52544, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1288000
2015-03-13 10:30:57,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:30:57,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:57,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:57,639 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:57,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000002_0 dst=null perm=null
2015-03-13 10:30:57,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009 src: /127.0.0.1:52545 dest: /127.0.0.1:52444
2015-03-13 10:30:57,687 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009 src: /127.0.0.1:52546 dest: /127.0.0.1:52447
2015-03-13 10:30:57,688 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009 src: /127.0.0.1:52547 dest: /127.0.0.1:52451
2015-03-13 10:30:57,700 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52547, dest: /127.0.0.1:52451, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 10591000
2015-03-13 10:30:57,701 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:57,702 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52546, dest: /127.0.0.1:52447, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 9508000
2015-03-13 10:30:57,702 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:57,703 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:57,703 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:57,704 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52545, dest: /127.0.0.1:52444, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 11354000
2015-03-13 10:30:57,704 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:57,705 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:57,710 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1
2015-03-13 10:30:57,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000003_0 dst=null perm=null
2015-03-13 10:30:57,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:57,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001 dst=null perm=null
2015-03-13 10:30:57,740 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000004
2015-03-13 10:30:57,741 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:57,741 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,741 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000004
2015-03-13 10:30:57,741 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,742 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,742 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:30:57,742 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:57,755 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000004 is : 143
2015-03-13 10:30:57,760 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:57,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010 src: /127.0.0.1:52548 dest: /127.0.0.1:52447
2015-03-13 10:30:57,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010 src: /127.0.0.1:52549 dest: /127.0.0.1:52444
2015-03-13 10:30:57,766 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010 src: /127.0.0.1:52550 dest: /127.0.0.1:52454
2015-03-13 10:30:57,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,773 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,774 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist for DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:30:57,774 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,776 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:57,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,777 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,778 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000004 from application application_1426267835672_0001
2015-03-13 10:30:57,778 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,778 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:57,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000001_0 dst=null perm=null
2015-03-13 10:30:57,812 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000003
2015-03-13 10:30:57,812 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:57,812 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,813 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000003
2015-03-13 10:30:57,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,814 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:30:57,814 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,814 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000004
2015-03-13 10:30:57,815 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,816 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:57,816 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:30:57,816 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:57,816 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:30:57,817 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:30:57,817 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,817 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,817 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:30:57,817 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000004 on node: host: 10.1.1.144:52473 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:30:57,826 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000003 is : 143
2015-03-13 10:30:57,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000000_0 dst=null perm=null
2015-03-13 10:30:57,841 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,843 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,843 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,844 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000002
2015-03-13 10:30:57,844 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:57,844 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,845 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,845 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,847 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,848 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:57,848 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,849 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000002
2015-03-13 10:30:57,860 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000002 is : 143
2015-03-13 10:30:57,872 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000003 from application application_1426267835672_0001
2015-03-13 10:30:57,873 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,873 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:57,873 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,874 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,875 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,878 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000005
2015-03-13 10:30:57,878 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:57,878 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000003
2015-03-13 10:30:57,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,880 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:57,880 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:30:57,880 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:57,880 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:30:57,880 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:30:57,880 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,881 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,881 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:30:57,881 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000003 on node: host: 10.1.1.144:52473 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:30:57,884 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,886 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,887 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,887 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:57,887 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,888 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000005
2015-03-13 10:30:57,897 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000005 is : 143
2015-03-13 10:30:57,910 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000002 from application application_1426267835672_0001
2015-03-13 10:30:57,912 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,912 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:57,913 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,913 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,914 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,915 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,917 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:57,917 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,917 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000005 from application application_1426267835672_0001
2015-03-13 10:30:57,917 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,918 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:58,308 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:58,884 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:58,884 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000002
2015-03-13 10:30:58,885 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:58,885 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000005
2015-03-13 10:30:58,886 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:58,886 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:30:58,886 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:58,886 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:30:58,887 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:30:58,887 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,887 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,887 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:30:58,888 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000002 on node: host: 10.1.1.144:52473 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:30:58,888 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:58,888 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:30:58,888 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:58,888 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:30:58,889 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:30:58,889 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,889 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,889 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:30:58,889 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000005 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:30:59,309 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:59,500 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009
2015-03-13 10:30:59,501 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009
2015-03-13 10:30:59,744 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009
2015-03-13 10:30:59,890 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:59,891 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:30:59,891 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:30:59,891 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000006, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:59,891 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:30:59,892 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:00,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:00,721 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:00,729 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000006 by user soberoi
2015-03-13 10:31:00,730 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:00,730 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000006 to application application_1426267835672_0001
2015-03-13 10:31:00,730 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:31:00,730 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:31:00,730 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:31:00,731 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:00,731 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:31:00,732 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:00,756 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:00,757 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:00,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006/default_container_executor.sh]
2015-03-13 10:31:00,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:00,890 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:01,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:01,729 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:01,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:02,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:02,897 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:03,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:31:03,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:03,335 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:03,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011 src: /127.0.0.1:52555 dest: /127.0.0.1:52451
2015-03-13 10:31:03,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011 src: /127.0.0.1:52556 dest: /127.0.0.1:52454
2015-03-13 10:31:03,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011 src: /127.0.0.1:52557 dest: /127.0.0.1:52444
2015-03-13 10:31:03,418 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52557, dest: /127.0.0.1:52444, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 11563000
2015-03-13 10:31:03,418 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,419 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:03,419 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52556, dest: /127.0.0.1:52454, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 12258000
2015-03-13 10:31:03,419 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,420 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:03,420 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52555, dest: /127.0.0.1:52451, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 13257000
2015-03-13 10:31:03,420 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,421 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:03,424 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1
2015-03-13 10:31:03,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:03,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:03,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,455 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:03,459 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012 src: /127.0.0.1:52558 dest: /127.0.0.1:52444
2015-03-13 10:31:03,462 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012 src: /127.0.0.1:52559 dest: /127.0.0.1:52454
2015-03-13 10:31:03,463 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012 src: /127.0.0.1:52560 dest: /127.0.0.1:52447
2015-03-13 10:31:03,469 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52560, dest: /127.0.0.1:52447, bytes: 294, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 4034000
2015-03-13 10:31:03,469 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,470 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,470 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52559, dest: /127.0.0.1:52454, bytes: 294, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 4526000
2015-03-13 10:31:03,471 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,472 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,472 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52558, dest: /127.0.0.1:52444, bytes: 294, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 6388000
2015-03-13 10:31:03,472 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,473 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,475 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1
2015-03-13 10:31:03,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0 dst=null perm=null
2015-03-13 10:31:03,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000 dst=null perm=null
2015-03-13 10:31:03,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0 dst=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:03,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000006
2015-03-13 10:31:03,496 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:03,496 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:31:03,497 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000006
2015-03-13 10:31:03,497 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:03,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,506 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,509 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000006 is : 143
2015-03-13 10:31:03,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1 dst=null perm=null
2015-03-13 10:31:03,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:31:03,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:31:03,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000 dst=null perm=null
2015-03-13 10:31:03,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000 dst=null perm=null
2015-03-13 10:31:03,525 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:03,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,527 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,526 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:03,527 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:03,527 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000006 from application application_1426267835672_0001
2015-03-13 10:31:03,527 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:03,527 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:31:03,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000/part-00000 dst=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary dst=null perm=null
2015-03-13 10:31:03,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,539 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,542 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,556 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52550, dest: /127.0.0.1:52454, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 5787960000
2015-03-13 10:31:03,556 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,557 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,557 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52549, dest: /127.0.0.1:52444, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 5789108000
2015-03-13 10:31:03,558 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,559 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,559 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52548, dest: /127.0.0.1:52447, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 5790653000
2015-03-13 10:31:03,559 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,560 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,561 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,566 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:03,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013 src: /127.0.0.1:52561 dest: /127.0.0.1:52454
2015-03-13 10:31:03,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013 src: /127.0.0.1:52562 dest: /127.0.0.1:52444
2015-03-13 10:31:03,572 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013 src: /127.0.0.1:52563 dest: /127.0.0.1:52447
2015-03-13 10:31:03,575 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52563, dest: /127.0.0.1:52447, bytes: 424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 1943000
2015-03-13 10:31:03,575 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,576 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,576 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52562, dest: /127.0.0.1:52444, bytes: 424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 2629000
2015-03-13 10:31:03,576 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,577 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,577 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52561, dest: /127.0.0.1:52454, bytes: 424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 3808000
2015-03-13 10:31:03,578 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,578 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,581 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist dst=null perm=null
2015-03-13 10:31:03,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:03,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist dst=null perm=null
2015-03-13 10:31:03,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:03,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist dst=null perm=null
2015-03-13 10:31:03,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,601 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52564, bytes: 60868, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 219000
2015-03-13 10:31:03,603 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:03,605 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014 src: /127.0.0.1:52565 dest: /127.0.0.1:52451
2015-03-13 10:31:03,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014 src: /127.0.0.1:52566 dest: /127.0.0.1:52454
2015-03-13 10:31:03,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014 src: /127.0.0.1:52567 dest: /127.0.0.1:52447
2015-03-13 10:31:03,613 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52567, dest: /127.0.0.1:52447, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, duration: 2394000
2015-03-13 10:31:03,613 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,614 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,614 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52566, dest: /127.0.0.1:52454, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, duration: 3018000
2015-03-13 10:31:03,614 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,615 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,615 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52565, dest: /127.0.0.1:52451, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, duration: 4371000
2015-03-13 10:31:03,615 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,616 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,617 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml dst=null perm=null
2015-03-13 10:31:03,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:03,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml dst=null perm=null
2015-03-13 10:31:03,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:03,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml dst=null perm=null
2015-03-13 10:31:03,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,633 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52564, bytes: 91714, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 510000
2015-03-13 10:31:03,635 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:03,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015 src: /127.0.0.1:52568 dest: /127.0.0.1:52451
2015-03-13 10:31:03,638 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015 src: /127.0.0.1:52569 dest: /127.0.0.1:52444
2015-03-13 10:31:03,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015 src: /127.0.0.1:52570 dest: /127.0.0.1:52454
2015-03-13 10:31:03,645 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52570, dest: /127.0.0.1:52454, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, duration: 3972000
2015-03-13 10:31:03,645 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,646 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,646 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52569, dest: /127.0.0.1:52444, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, duration: 4774000
2015-03-13 10:31:03,646 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,647 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,647 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52568, dest: /127.0.0.1:52451, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, duration: 5789000
2015-03-13 10:31:03,647 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,648 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,650 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,669 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:03,670 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0001
2015-03-13 10:31:03,670 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from RUNNING to REMOVING
2015-03-13 10:31:03,670 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0001
2015-03-13 10:31:03,672 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from REMOVING to FINISHING
2015-03-13 10:31:04,318 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:04,501 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:04,501 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000006
2015-03-13 10:31:04,502 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:04,502 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:31:04,502 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:04,503 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:04,503 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:04,503 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000006, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:04,503 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:04,504 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:04,504 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000006 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:04,505 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012
2015-03-13 10:31:04,507 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011
2015-03-13 10:31:04,507 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010
2015-03-13 10:31:04,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010
2015-03-13 10:31:04,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013
2015-03-13 10:31:04,508 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012
2015-03-13 10:31:04,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013
2015-03-13 10:31:04,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014
2015-03-13 10:31:04,510 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015
2015-03-13 10:31:04,685 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741828_1004 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52447
2015-03-13 10:31:04,685 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451
2015-03-13 10:31:04,685 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52451
2015-03-13 10:31:04,685 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447
2015-03-13 10:31:04,686 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:31:04,686 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52454
2015-03-13 10:31:04,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001 dst=null perm=null
2015-03-13 10:31:04,750 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014
2015-03-13 10:31:04,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011
2015-03-13 10:31:04,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015
2015-03-13 10:31:04,752 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (2/2) ...atform/eacheverychain/tap
2015-03-13 10:31:04,762 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:04,773 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:04,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:04,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:04,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:04,782 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 2
2015-03-13 10:31:04,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002 dst=null perm=null
2015-03-13 10:31:04,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:04,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:31:04,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:04,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,791 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:04,792 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52573 dest: /127.0.0.1:52447
2015-03-13 10:31:04,793 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52574 dest: /127.0.0.1:52451
2015-03-13 10:31:04,794 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52575 dest: /127.0.0.1:52444
2015-03-13 10:31:04,799 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52575, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 2883000
2015-03-13 10:31:04,799 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,799 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,800 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52574, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 3414000
2015-03-13 10:31:04,800 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,800 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,801 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52573, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 4145000
2015-03-13 10:31:04,801 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,802 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,803 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,804 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar
2015-03-13 10:31:04,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:04,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:04,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:04,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:04,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:04,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:04,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:04,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:04,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:04,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:04,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:31:04,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:31:04,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:31:04,822 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:04,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,827 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split
2015-03-13 10:31:04,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:04,828 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:04,830 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52576 dest: /127.0.0.1:52451
2015-03-13 10:31:04,832 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52577 dest: /127.0.0.1:52454
2015-03-13 10:31:04,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52578 dest: /127.0.0.1:52444
2015-03-13 10:31:04,834 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52579 dest: /127.0.0.1:52447
2015-03-13 10:31:04,838 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52579, dest: /127.0.0.1:52447, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 2247000
2015-03-13 10:31:04,838 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,838 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,839 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52578, dest: /127.0.0.1:52444, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 2791000
2015-03-13 10:31:04,839 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,839 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,839 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52577, dest: /127.0.0.1:52454, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 3488000
2015-03-13 10:31:04,840 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,840 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,840 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52576, dest: /127.0.0.1:52451, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 4742000
2015-03-13 10:31:04,841 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,841 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,843 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,848 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:04,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018 src: /127.0.0.1:52580 dest: /127.0.0.1:52454
2015-03-13 10:31:04,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018 src: /127.0.0.1:52581 dest: /127.0.0.1:52447
2015-03-13 10:31:04,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018 src: /127.0.0.1:52582 dest: /127.0.0.1:52444
2015-03-13 10:31:04,854 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52582, dest: /127.0.0.1:52444, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 1683000
2015-03-13 10:31:04,854 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,855 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,855 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52581, dest: /127.0.0.1:52447, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 2270000
2015-03-13 10:31:04,855 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,856 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,856 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52580, dest: /127.0.0.1:52454, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 3205000
2015-03-13 10:31:04,856 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,857 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,858 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,859 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:31:04,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:04,867 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:04,868 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:04,894 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:04,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019 src: /127.0.0.1:52583 dest: /127.0.0.1:52447
2015-03-13 10:31:04,896 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015
2015-03-13 10:31:04,897 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014
2015-03-13 10:31:04,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019 src: /127.0.0.1:52584 dest: /127.0.0.1:52451
2015-03-13 10:31:04,897 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011
2015-03-13 10:31:04,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013
2015-03-13 10:31:04,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018
2015-03-13 10:31:04,899 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012
2015-03-13 10:31:04,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019 src: /127.0.0.1:52585 dest: /127.0.0.1:52444
2015-03-13 10:31:04,899 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010
2015-03-13 10:31:04,900 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:04,908 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52585, dest: /127.0.0.1:52444, bytes: 98524, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 7490000
2015-03-13 10:31:04,909 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,909 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,910 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52584, dest: /127.0.0.1:52451, bytes: 98524, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 8230000
2015-03-13 10:31:04,910 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,911 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52583, dest: /127.0.0.1:52447, bytes: 98524, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 9567000
2015-03-13 10:31:04,911 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,914 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,915 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0002
2015-03-13 10:31:04,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002 dst=null perm=null
2015-03-13 10:31:04,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:04,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:04,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:04,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:04,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:04,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:04,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:04,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:04,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:04,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:04,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:04,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:04,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:04,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:04,938 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 2 submitted by user soberoi
2015-03-13 10:31:04,938 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0002
2015-03-13 10:31:04,938 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0002
2015-03-13 10:31:04,938 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0002
2015-03-13 10:31:04,938 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from NEW to NEW_SAVING
2015-03-13 10:31:04,939 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:04,939 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0002_000001
2015-03-13 10:31:04,939 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:04,940 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0002 from user: soberoi activated in queue: default
2015-03-13 10:31:04,940 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0002 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:04,940 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0002 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:04,940 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0002_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:04,941 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0002 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:04,941 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:04,941 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:04,943 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0002/
2015-03-13 10:31:04,944 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0002
2015-03-13 10:31:04,944 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0002/
2015-03-13 10:31:05,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:05,162 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:05,163 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:31:05,163 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0002 container=Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0002_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:05,164 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:05,165 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:05,165 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:05,166 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0002 AttemptId: appattempt_1426267835672_0002_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:31:05,166 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:05,166 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0002_000001
2015-03-13 10:31:05,166 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:05,167 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0002_000001
2015-03-13 10:31:05,168 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0002_000001
2015-03-13 10:31:05,168 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:31:05,172 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:05,175 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0002_01_000001 by user soberoi
2015-03-13 10:31:05,176 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0002
2015-03-13 10:31:05,176 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:05,177 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from NEW to INITING
2015-03-13 10:31:05,178 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0002_01_000001 to application application_1426267835672_0002
2015-03-13 10:31:05,178 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0002_000001
2015-03-13 10:31:05,178 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from INITING to RUNNING
2015-03-13 10:31:05,179 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:05,179 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:05,179 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0002
2015-03-13 10:31:05,179 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,179 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0002_01_000001
2015-03-13 10:31:05,181 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:31:05,183 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:31:05,194 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0002_01_000001.tokens. Credentials list:
2015-03-13 10:31:05,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:05,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:05,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:05,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:05,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:05,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:05,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:05,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:05,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:05,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:05,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:05,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:05,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:05,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:05,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:05,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:05,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:05,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:05,216 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:05,225 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52587, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 1280000
2015-03-13 10:31:05,225 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52588, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 1470000
2015-03-13 10:31:05,248 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,249 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001.tokens
2015-03-13 10:31:05,314 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:05,320 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:05,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:05,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:05,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:05,385 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52591, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 512000
2015-03-13 10:31:05,404 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:05,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:05,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:05,431 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52587, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 215000
2015-03-13 10:31:05,444 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:05,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:05,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:05,469 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52591, bytes: 354, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 226000
2015-03-13 10:31:05,482 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:05,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:05,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:05,506 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52588, bytes: 99296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 383000
2015-03-13 10:31:05,519 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,519 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:05,546 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:05,546 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:05,611 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001/default_container_executor.sh]
2015-03-13 10:31:06,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:06,165 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:06,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:06,867 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741840_1016 to datanode(s) 127.0.0.1:52454
2015-03-13 10:31:06,867 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741832_1008, blk_1073741834_1010]
2015-03-13 10:31:06,867 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741831_1007, blk_1073741832_1008, blk_1073741834_1010]
2015-03-13 10:31:07,168 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:07,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:07,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_STARTED dst=null perm=null
2015-03-13 10:31:07,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:31:07,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_FAIL dst=null perm=null
2015-03-13 10:31:07,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002 dst=null perm=null
2015-03-13 10:31:07,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:31:07,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:31:07,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:07,538 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 to 127.0.0.1:52454
2015-03-13 10:31:07,539 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:07,540 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:07,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52593 dest: /127.0.0.1:52454
2015-03-13 10:31:07,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:07,541 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:31:07,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:07,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831 for deletion
2015-03-13 10:31:07,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832 for deletion
2015-03-13 10:31:07,564 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834 for deletion
2015-03-13 10:31:07,564 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831
2015-03-13 10:31:07,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832
2015-03-13 10:31:07,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834
2015-03-13 10:31:07,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52593 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:31:07,566 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741840_1016 size 254067
2015-03-13 10:31:07,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:07,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:07,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52594, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 227000
2015-03-13 10:31:07,911 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:07,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:07,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:07,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830 for deletion
2015-03-13 10:31:07,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832 for deletion
2015-03-13 10:31:07,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:07,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832
2015-03-13 10:31:07,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830
2015-03-13 10:31:07,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834 for deletion
2015-03-13 10:31:07,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834
2015-03-13 10:31:08,171 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:08,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:08,409 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:08,414 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0002_000001
2015-03-13 10:31:08,414 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0002 APPATTEMPTID=appattempt_1426267835672_0002_000001
2015-03-13 10:31:08,414 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:31:08,415 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from ACCEPTED to RUNNING
2015-03-13 10:31:08,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:08,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:08,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:08,660 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:08,705 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020 src: /127.0.0.1:52600 dest: /127.0.0.1:52444
2015-03-13 10:31:08,707 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020 src: /127.0.0.1:52601 dest: /127.0.0.1:52454
2015-03-13 10:31:08,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020 src: /127.0.0.1:52602 dest: /127.0.0.1:52451
2015-03-13 10:31:08,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52602, dest: /127.0.0.1:52451, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 7063000
2015-03-13 10:31:08,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:08,720 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52601, dest: /127.0.0.1:52454, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 7871000
2015-03-13 10:31:08,720 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:08,720 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:08,721 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52600, dest: /127.0.0.1:52444, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 9535000
2015-03-13 10:31:08,722 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:08,722 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:08,723 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:08,727 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:09,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:09,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:09,512 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019
2015-03-13 10:31:09,513 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018
2015-03-13 10:31:09,515 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:09,515 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:09,516 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:09,516 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:09,517 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:09,517 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0002 container=Container: [ContainerId: container_1426267835672_0002_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0002_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:09,517 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:31:09,517 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:09,517 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020
2015-03-13 10:31:09,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:09,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019
2015-03-13 10:31:09,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018
2015-03-13 10:31:09,522 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:09,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:09,762 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:09,763 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019
2015-03-13 10:31:09,763 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020
2015-03-13 10:31:09,819 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0001_01_000001 succeeded
2015-03-13 10:31:09,819 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:31:09,819 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000001
2015-03-13 10:31:09,827 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,828 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,828 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,829 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,829 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:31:09,829 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:31:09,830 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000001 from application application_1426267835672_0001
2015-03-13 10:31:09,830 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:09,830 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:31:09,868 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741834_1010]
2015-03-13 10:31:09,868 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008]
2015-03-13 10:31:09,907 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020
2015-03-13 10:31:09,909 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:10,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:10,337 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:31:10,337 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000001
2015-03-13 10:31:10,338 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:10,338 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:31:10,338 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0001_000001
2015-03-13 10:31:10,338 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0001 CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:31:10,338 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:10,338 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:31:10,339 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:10,339 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:10,339 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:31:10,339 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000001 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:10,339 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from FINISHING to FINISHED
2015-03-13 10:31:10,340 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from FINISHING to FINISHED
2015-03-13 10:31:10,341 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0001_000001 is done. finalState=FINISHED
2015-03-13 10:31:10,341 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0001_000001
2015-03-13 10:31:10,342 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0001
2015-03-13 10:31:10,341 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0001 requests cleared
2015-03-13 10:31:10,342 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0001 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:31:10,342 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:31:10,343 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0001,name=[61C1702FCC0A429FBD628FD813F0535B/26757E2D2BB340BFA59A7DCBA8B66383] trap test/(1/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0001/jobhistory/job/job_1426267835672_0001,appMasterHost=Edinburgh.local,startTime=1426267844187,finishTime=1426267863672,finalStatus=SUCCEEDED
2015-03-13 10:31:10,344 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:31:10,348 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000001
2015-03-13 10:31:10,451 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:10,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:10,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:10,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:10,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:10,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:10,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:10,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:10,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:10,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:10,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:10,522 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:10,523 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,523 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0001
2015-03-13 10:31:10,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,524 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:10,525 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0001, with delay of 10800 seconds
2015-03-13 10:31:10,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,540 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:10,540 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:10,540 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:10,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830 for deletion
2015-03-13 10:31:10,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:10,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831 for deletion
2015-03-13 10:31:10,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830
2015-03-13 10:31:10,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834 for deletion
2015-03-13 10:31:10,541 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831
2015-03-13 10:31:10,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834
2015-03-13 10:31:10,567 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:10,570 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0002_01_000002 by user soberoi
2015-03-13 10:31:10,570 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0002
2015-03-13 10:31:10,570 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:10,570 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from NEW to INITING
2015-03-13 10:31:10,570 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0002_01_000002 to application application_1426267835672_0002
2015-03-13 10:31:10,571 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from INITING to RUNNING
2015-03-13 10:31:10,571 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:31:10,571 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0002
2015-03-13 10:31:10,571 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0002
2015-03-13 10:31:10,571 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:10,571 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0002
2015-03-13 10:31:10,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:10,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:10,572 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0002_01_000002
2015-03-13 10:31:10,582 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0002_01_000002.tokens. Credentials list:
2015-03-13 10:31:10,597 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:10,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0002_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002.tokens
2015-03-13 10:31:10,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:10,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:10,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:10,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:10,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52607, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1224896389_1477, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 577000
2015-03-13 10:31:10,756 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:10,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:10,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:10,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:10,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830 for deletion
2015-03-13 10:31:10,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831 for deletion
2015-03-13 10:31:10,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832 for deletion
2015-03-13 10:31:10,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:10,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830
2015-03-13 10:31:10,761 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831
2015-03-13 10:31:10,761 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832
2015-03-13 10:31:10,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:10,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:10,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:10,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52607, bytes: 99296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1224896389_1477, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 330000
2015-03-13 10:31:10,795 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:10,795 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:10,824 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:10,824 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:10,891 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002/default_container_executor.sh]
2015-03-13 10:31:11,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:11,339 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:11,340 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0001
2015-03-13 10:31:11,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,341 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,340 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:11,341 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,341 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0001, with delay of 10800 seconds
2015-03-13 10:31:11,465 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:11,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:11,525 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:12,040 INFO hs.JobHistory (JobHistory.java:run(188)) - History Cleaner started
2015-03-13 10:31:12,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null
2015-03-13 10:31:12,042 INFO hs.JobHistory (JobHistory.java:run(194)) - History Cleaner complete
2015-03-13 10:31:12,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:12,531 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:12,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split dst=null perm=null
2015-03-13 10:31:12,969 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52610, bytes: 354, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0002_m_000000_0_-1766763401_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 211000
2015-03-13 10:31:13,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000 dst=null perm=null
2015-03-13 10:31:13,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000 dst=null perm=null
2015-03-13 10:31:13,026 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52611, bytes: 298, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0002_m_000000_0_-1766763401_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 224000
2015-03-13 10:31:13,190 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:13,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_m_000000_0 dst=null perm=null
2015-03-13 10:31:13,378 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0002_01_000002
2015-03-13 10:31:13,378 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:13,378 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:31:13,378 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0002_01_000002
2015-03-13 10:31:13,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:13,387 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0002_01_000002 is : 143
2015-03-13 10:31:13,392 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:13,393 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021 src: /127.0.0.1:52612 dest: /127.0.0.1:52451
2015-03-13 10:31:13,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021 src: /127.0.0.1:52613 dest: /127.0.0.1:52454
2015-03-13 10:31:13,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021 src: /127.0.0.1:52614 dest: /127.0.0.1:52444
2015-03-13 10:31:13,399 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:13,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:13,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,400 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0002_01_000002 from application application_1426267835672_0002
2015-03-13 10:31:13,400 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:13,400 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0002
2015-03-13 10:31:13,401 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist for DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:14,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:14,379 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:14,380 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0002_01_000002
2015-03-13 10:31:14,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:14,380 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0002_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:31:14,381 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:14,381 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:14,381 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:14,381 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0002_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:14,381 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:14,382 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:14,382 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0002_000001 released container container_1426267835672_0002_01_000002 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:14,620 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:14,620 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:14,620 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:14,621 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0002 container=Container: [ContainerId: container_1426267835672_0002_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0002_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:14,621 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:14,621 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:15,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:15,486 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:15,498 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:15,501 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0002_01_000003 by user soberoi
2015-03-13 10:31:15,502 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0002
2015-03-13 10:31:15,502 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:15,503 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from NEW to INITING
2015-03-13 10:31:15,504 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0002_01_000003 to application application_1426267835672_0002
2015-03-13 10:31:15,504 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from INITING to RUNNING
2015-03-13 10:31:15,505 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:31:15,505 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0002
2015-03-13 10:31:15,505 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0002
2015-03-13 10:31:15,505 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:15,505 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0002
2015-03-13 10:31:15,505 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,505 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,505 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,506 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,506 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0002_01_000003
2015-03-13 10:31:15,506 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:31:15,508 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:31:15,519 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0002_01_000003.tokens. Credentials list:
2015-03-13 10:31:15,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:15,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:15,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:15,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:15,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:15,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:15,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:15,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:15,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:15,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:15,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:15,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:15,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:15,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:15,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:15,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:15,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:15,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:15,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:15,548 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52617, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 1114000
2015-03-13 10:31:15,548 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52618, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 1206000
2015-03-13 10:31:15,574 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,577 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,621 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:15,621 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:15,644 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0002_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003.tokens
2015-03-13 10:31:15,644 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:15,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:15,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:15,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar dst=null perm=null
2015-03-13 10:31:15,721 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52618, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1001803561_1589, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 459000
2015-03-13 10:31:15,742 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:15,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:15,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml dst=null perm=null
2015-03-13 10:31:15,767 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52617, bytes: 99296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1001803561_1589, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 329000
2015-03-13 10:31:15,780 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,780 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:15,807 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:15,807 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:15,875 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003/default_container_executor.sh]
2015-03-13 10:31:16,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:16,493 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:16,625 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:17,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:17,627 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:18,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:31:18,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:18,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,221 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:18,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022 src: /127.0.0.1:52624 dest: /127.0.0.1:52454
2015-03-13 10:31:18,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022 src: /127.0.0.1:52625 dest: /127.0.0.1:52444
2015-03-13 10:31:18,280 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022 src: /127.0.0.1:52626 dest: /127.0.0.1:52447
2015-03-13 10:31:18,290 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52626, dest: /127.0.0.1:52447, bytes: 27, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 8589000
2015-03-13 10:31:18,291 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,292 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52625, dest: /127.0.0.1:52444, bytes: 27, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 10299000
2015-03-13 10:31:18,292 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,293 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52624, dest: /127.0.0.1:52454, bytes: 27, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 11187000
2015-03-13 10:31:18,293 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,296 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000 is closed by DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1
2015-03-13 10:31:18,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:18,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000 dst=null perm=null
2015-03-13 10:31:18,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,330 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:18,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023 src: /127.0.0.1:52627 dest: /127.0.0.1:52454
2015-03-13 10:31:18,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023 src: /127.0.0.1:52628 dest: /127.0.0.1:52451
2015-03-13 10:31:18,338 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023 src: /127.0.0.1:52629 dest: /127.0.0.1:52444
2015-03-13 10:31:18,341 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52629, dest: /127.0.0.1:52444, bytes: 85, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 1800000
2015-03-13 10:31:18,341 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,342 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52628, dest: /127.0.0.1:52451, bytes: 85, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 2393000
2015-03-13 10:31:18,342 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,343 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52627, dest: /127.0.0.1:52454, bytes: 85, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 3530000
2015-03-13 10:31:18,343 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,344 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,345 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1
2015-03-13 10:31:18,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0 dst=null perm=null
2015-03-13 10:31:18,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000 dst=null perm=null
2015-03-13 10:31:18,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:18,365 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0002_01_000003
2015-03-13 10:31:18,365 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:18,365 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:31:18,366 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0002_01_000003
2015-03-13 10:31:18,366 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:18,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,374 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,378 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0002_01_000003 is : 143
2015-03-13 10:31:18,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1 dst=null perm=null
2015-03-13 10:31:18,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:18,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:18,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000 dst=null perm=null
2015-03-13 10:31:18,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000 dst=null perm=null
2015-03-13 10:31:18,392 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:18,393 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,394 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,394 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:18,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,399 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:18,399 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0002_01_000003 from application application_1426267835672_0002
2015-03-13 10:31:18,399 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:18,399 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0002
2015-03-13 10:31:18,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary dst=null perm=null
2015-03-13 10:31:18,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,412 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,416 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,429 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52614, dest: /127.0.0.1:52444, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 5031285000
2015-03-13 10:31:18,429 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,430 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,430 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52613, dest: /127.0.0.1:52454, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 5032187000
2015-03-13 10:31:18,430 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,431 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,431 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52612, dest: /127.0.0.1:52451, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 5033671000
2015-03-13 10:31:18,431 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,432 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,433 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,437 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:18,439 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024 src: /127.0.0.1:52630 dest: /127.0.0.1:52447
2015-03-13 10:31:18,441 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024 src: /127.0.0.1:52631 dest: /127.0.0.1:52444
2015-03-13 10:31:18,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024 src: /127.0.0.1:52632 dest: /127.0.0.1:52454
2015-03-13 10:31:18,444 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52632, dest: /127.0.0.1:52454, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 1565000
2015-03-13 10:31:18,445 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,445 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,445 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52631, dest: /127.0.0.1:52444, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 2229000
2015-03-13 10:31:18,446 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,446 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,446 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52630, dest: /127.0.0.1:52447, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 3114000
2015-03-13 10:31:18,446 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,447 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,448 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist dst=null perm=null
2015-03-13 10:31:18,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:18,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist dst=null perm=null
2015-03-13 10:31:18,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:18,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist dst=null perm=null
2015-03-13 10:31:18,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,468 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52633, bytes: 37222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 226000
2015-03-13 10:31:18,470 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:18,472 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025 src: /127.0.0.1:52634 dest: /127.0.0.1:52447
2015-03-13 10:31:18,474 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025 src: /127.0.0.1:52635 dest: /127.0.0.1:52444
2015-03-13 10:31:18,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025 src: /127.0.0.1:52636 dest: /127.0.0.1:52454
2015-03-13 10:31:18,480 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52636, dest: /127.0.0.1:52454, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, duration: 1676000
2015-03-13 10:31:18,480 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,481 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,481 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52635, dest: /127.0.0.1:52444, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, duration: 2430000
2015-03-13 10:31:18,481 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,482 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,482 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52634, dest: /127.0.0.1:52447, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, duration: 3512000
2015-03-13 10:31:18,482 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,482 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,484 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml dst=null perm=null
2015-03-13 10:31:18,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:18,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml dst=null perm=null
2015-03-13 10:31:18,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:18,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml dst=null perm=null
2015-03-13 10:31:18,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,495 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52633, bytes: 91862, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 338000
2015-03-13 10:31:18,496 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:18,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026 src: /127.0.0.1:52637 dest: /127.0.0.1:52454
2015-03-13 10:31:18,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026 src: /127.0.0.1:52638 dest: /127.0.0.1:52451
2015-03-13 10:31:18,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026 src: /127.0.0.1:52639 dest: /127.0.0.1:52447
2015-03-13 10:31:18,505 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52639, dest: /127.0.0.1:52447, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, duration: 3197000
2015-03-13 10:31:18,505 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,505 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,506 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52638, dest: /127.0.0.1:52451, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, duration: 3715000
2015-03-13 10:31:18,506 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,506 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,507 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52637, dest: /127.0.0.1:52454, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, duration: 4759000
2015-03-13 10:31:18,507 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,507 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,509 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,525 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:18,525 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0002
2015-03-13 10:31:18,525 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from RUNNING to REMOVING
2015-03-13 10:31:18,525 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0002
2015-03-13 10:31:18,526 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from REMOVING to FINISHING
2015-03-13 10:31:19,207 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:19,369 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:19,370 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0002_01_000003
2015-03-13 10:31:19,370 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:19,370 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0002_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:31:19,370 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:19,371 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:19,371 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:19,371 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0002_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:19,371 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:19,372 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:19,372 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0002_000001 released container container_1426267835672_0002_01_000003 on node: host: 10.1.1.144:52469 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:19,524 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024
2015-03-13 10:31:19,525 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026
2015-03-13 10:31:19,525 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022
2015-03-13 10:31:19,526 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025
2015-03-13 10:31:19,535 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024
2015-03-13 10:31:19,535 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023
2015-03-13 10:31:19,536 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025
2015-03-13 10:31:19,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021
2015-03-13 10:31:19,537 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:31:19,538 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:31:19,538 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022
2015-03-13 10:31:19,538 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:31:19,538 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444
2015-03-13 10:31:19,538 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:31:19,538 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:31:19,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002 dst=null perm=null
2015-03-13 10:31:19,574 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52447
2015-03-13 10:31:19,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335 dst=null perm=null
2015-03-13 10:31:19,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,577 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary
2015-03-13 10:31:19,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:31:19,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:31:19,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,580 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary
2015-03-13 10:31:19,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:31:19,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,582 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary
2015-03-13 10:31:19,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary dst=null perm=null
2015-03-13 10:31:19,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,583 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary
2015-03-13 10:31:19,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary dst=null perm=null
2015-03-13 10:31:19,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:19,596 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:19,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,601 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:19,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000 dst=null perm=null
2015-03-13 10:31:19,612 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52640, bytes: 89, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 175000
2015-03-13 10:31:19,621 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,622 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:19,623 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:19,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,628 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 3
2015-03-13 10:31:19,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:19,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 215000
2015-03-13 10:31:19,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:19,633 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52640, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 161000
2015-03-13 10:31:19,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000 dst=null perm=null
2015-03-13 10:31:19,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 31, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 206000
2015-03-13 10:31:19,636 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/eacheverychain/trap
2015-03-13 10:31:19,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap dst=null perm=null
2015-03-13 10:31:19,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:19,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:19,643 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 176000
2015-03-13 10:31:19,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:19,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:19,646 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52640, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 182000
2015-03-13 10:31:19,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000 dst=null perm=null
2015-03-13 10:31:19,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000 dst=null perm=null
2015-03-13 10:31:19,650 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52642, bytes: 31, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 218000
2015-03-13 10:31:19,650 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/eacheverychain/tap
2015-03-13 10:31:19,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap dst=null perm=null
2015-03-13 10:31:19,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000 dst=null perm=null
2015-03-13 10:31:19,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000 dst=null perm=null
2015-03-13 10:31:19,657 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 89, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 204000
2015-03-13 10:31:19,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:19,677 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,681 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:31:19,681 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:31:19,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:19,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:19,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:31:19,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:31:19,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap"]
2015-03-13 10:31:19,700 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:31:19,701 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:31:19,701 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:31:19,701 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...atform/everyaggregate/tap
2015-03-13 10:31:19,711 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:19,720 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:19,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:19,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:19,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:19,726 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 3
2015-03-13 10:31:19,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003 dst=null perm=null
2015-03-13 10:31:19,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:19,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:31:19,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:19,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,734 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:19,735 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52644 dest: /127.0.0.1:52444
2015-03-13 10:31:19,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52645 dest: /127.0.0.1:52451
2015-03-13 10:31:19,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52646 dest: /127.0.0.1:52447
2015-03-13 10:31:19,742 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52646, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 3107000
2015-03-13 10:31:19,743 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,743 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:19,743 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52645, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 4086000
2015-03-13 10:31:19,744 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,744 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:19,744 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52644, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 4482000
2015-03-13 10:31:19,744 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,746 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:19,747 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,748 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar
2015-03-13 10:31:19,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:19,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:19,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:19,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:19,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:19,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:19,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:19,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:19,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:19,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:19,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:19,758 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:19,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:19,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,765 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split
2015-03-13 10:31:19,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:19,767 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:19,769 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52647 dest: /127.0.0.1:52454
2015-03-13 10:31:19,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52648 dest: /127.0.0.1:52444
2015-03-13 10:31:19,771 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023
2015-03-13 10:31:19,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52649 dest: /127.0.0.1:52447
2015-03-13 10:31:19,771 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021
2015-03-13 10:31:19,773 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026
2015-03-13 10:31:19,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52650 dest: /127.0.0.1:52451
2015-03-13 10:31:19,776 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52650, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 1899000
2015-03-13 10:31:19,776 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,777 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,777 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52649, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 2563000
2015-03-13 10:31:19,777 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,778 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,778 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52648, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 3570000
2015-03-13 10:31:19,778 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,779 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,779 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52647, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 4175000
2015-03-13 10:31:19,779 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,779 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,783 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,788 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:19,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029 src: /127.0.0.1:52651 dest: /127.0.0.1:52454
2015-03-13 10:31:19,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029 src: /127.0.0.1:52652 dest: /127.0.0.1:52447
2015-03-13 10:31:19,792 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029 src: /127.0.0.1:52653 dest: /127.0.0.1:52444
2015-03-13 10:31:19,795 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52653, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 1512000
2015-03-13 10:31:19,795 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,795 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,796 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52652, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 2187000
2015-03-13 10:31:19,796 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,796 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,797 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52651, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 3120000
2015-03-13 10:31:19,797 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,798 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,799 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,799 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:31:19,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,804 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:19,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:19,817 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:19,819 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030 src: /127.0.0.1:52654 dest: /127.0.0.1:52454
2015-03-13 10:31:19,820 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030 src: /127.0.0.1:52655 dest: /127.0.0.1:52447
2015-03-13 10:31:19,821 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030 src: /127.0.0.1:52656 dest: /127.0.0.1:52444
2015-03-13 10:31:19,825 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52656, dest: /127.0.0.1:52444, bytes: 98170, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 1898000
2015-03-13 10:31:19,825 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,826 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,826 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52655, dest: /127.0.0.1:52447, bytes: 98170, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 2729000
2015-03-13 10:31:19,826 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,827 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,827 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52654, dest: /127.0.0.1:52454, bytes: 98170, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 3553000
2015-03-13 10:31:19,827 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,828 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,829 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,830 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0003
2015-03-13 10:31:19,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003 dst=null perm=null
2015-03-13 10:31:19,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:19,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:19,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:19,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:19,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:19,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:19,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:19,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:19,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:19,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:19,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:19,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:19,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:19,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:19,846 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 3 submitted by user soberoi
2015-03-13 10:31:19,846 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0003
2015-03-13 10:31:19,846 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0003
2015-03-13 10:31:19,846 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0003
2015-03-13 10:31:19,846 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from NEW to NEW_SAVING
2015-03-13 10:31:19,847 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:19,847 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0003_000001
2015-03-13 10:31:19,847 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:19,848 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0003 from user: soberoi activated in queue: default
2015-03-13 10:31:19,848 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0003 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:19,848 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0003 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:19,848 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0003_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:19,848 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0003 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:19,849 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:19,849 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:19,851 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0003/
2015-03-13 10:31:19,851 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0003
2015-03-13 10:31:19,851 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0003/
2015-03-13 10:31:19,912 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024
2015-03-13 10:31:19,912 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022
2015-03-13 10:31:19,913 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:19,913 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023
2015-03-13 10:31:19,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021
2015-03-13 10:31:19,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025
2015-03-13 10:31:19,915 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026
2015-03-13 10:31:19,915 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029
2015-03-13 10:31:19,916 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030
2015-03-13 10:31:19,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:19,978 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:20,211 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:20,213 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:20,213 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:20,213 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:31:20,214 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0003_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:20,214 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:20,215 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:20,215 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:20,215 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0003 AttemptId: appattempt_1426267835672_0003_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:31:20,215 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:20,215 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0003_000001
2015-03-13 10:31:20,216 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:20,216 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0003_000001
2015-03-13 10:31:20,217 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0003_000001
2015-03-13 10:31:20,217 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:31:20,220 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:20,222 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000001 by user soberoi
2015-03-13 10:31:20,222 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0003
2015-03-13 10:31:20,222 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:20,222 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from NEW to INITING
2015-03-13 10:31:20,223 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000001 to application application_1426267835672_0003
2015-03-13 10:31:20,224 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from INITING to RUNNING
2015-03-13 10:31:20,224 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0003_000001
2015-03-13 10:31:20,224 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:20,224 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:20,224 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:20,225 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000001
2015-03-13 10:31:20,234 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0003_01_000001.tokens. Credentials list:
2015-03-13 10:31:20,249 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:20,326 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001.tokens
2015-03-13 10:31:20,327 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:20,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:20,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:20,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:20,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52642, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 644000
2015-03-13 10:31:20,416 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:20,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:20,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:20,441 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52660, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 131000
2015-03-13 10:31:20,453 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:20,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:20,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:20,478 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 199000
2015-03-13 10:31:20,490 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:20,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:20,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:20,515 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52642, bytes: 98938, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 332000
2015-03-13 10:31:20,527 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,527 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:20,553 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:20,553 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:20,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001/default_container_executor.sh]
2015-03-13 10:31:21,213 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:21,213 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:21,214 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:21,881 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52447 to replicate blk_1073741851_1027 to datanode(s) 127.0.0.1:52454
2015-03-13 10:31:21,882 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021]
2015-03-13 10:31:21,882 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741844_1020, blk_1073741845_1021, blk_1073741836_1012]
2015-03-13 10:31:22,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:22,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_STARTED dst=null perm=null
2015-03-13 10:31:22,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:31:22,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_FAIL dst=null perm=null
2015-03-13 10:31:22,214 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:22,214 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:22,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003 dst=null perm=null
2015-03-13 10:31:22,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:31:22,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:31:22,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:22,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:22,559 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-898105819-10.1.1.144-52447-1426267834396, infoPort=52448, ipcPort=52450, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 to 127.0.0.1:52454
2015-03-13 10:31:22,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52662 dest: /127.0.0.1:52454
2015-03-13 10:31:22,561 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:31:22,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52662 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:31:22,563 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741851_1027 size 254067
2015-03-13 10:31:22,597 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52663, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 226000
2015-03-13 10:31:22,763 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:22,763 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:22,763 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843 for deletion
2015-03-13 10:31:22,763 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844 for deletion
2015-03-13 10:31:22,763 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845 for deletion
2015-03-13 10:31:22,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:22,764 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843
2015-03-13 10:31:22,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845
2015-03-13 10:31:22,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:22,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844
2015-03-13 10:31:22,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:22,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:22,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842 for deletion
2015-03-13 10:31:22,917 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844 for deletion
2015-03-13 10:31:22,917 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845 for deletion
2015-03-13 10:31:22,917 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836 for deletion
2015-03-13 10:31:22,917 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:22,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:22,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845
2015-03-13 10:31:22,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836
2015-03-13 10:31:22,918 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842
2015-03-13 10:31:22,919 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844
2015-03-13 10:31:23,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:23,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:23,338 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:23,340 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0003_000001
2015-03-13 10:31:23,341 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0003 APPATTEMPTID=appattempt_1426267835672_0003_000001
2015-03-13 10:31:23,341 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:31:23,341 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from ACCEPTED to RUNNING
2015-03-13 10:31:23,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:23,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:23,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:23,560 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:23,598 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031 src: /127.0.0.1:52669 dest: /127.0.0.1:52451
2015-03-13 10:31:23,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031 src: /127.0.0.1:52670 dest: /127.0.0.1:52444
2015-03-13 10:31:23,601 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031 src: /127.0.0.1:52671 dest: /127.0.0.1:52447
2015-03-13 10:31:23,613 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52671, dest: /127.0.0.1:52447, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 9954000
2015-03-13 10:31:23,613 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:23,614 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:23,614 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52670, dest: /127.0.0.1:52444, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 10860000
2015-03-13 10:31:23,614 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:23,615 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:23,615 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52669, dest: /127.0.0.1:52451, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 11961000
2015-03-13 10:31:23,615 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:23,615 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:23,624 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:24,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:24,226 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:24,370 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,370 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:24,370 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:24,370 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,371 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:31:24,371 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,371 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,371 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:24,371 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:31:24,372 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,372 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:31:24,372 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,373 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,373 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:24,373 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:31:24,373 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,373 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:31:24,373 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,374 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,374 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:24,374 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:31:24,374 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,374 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:31:24,374 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,536 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:24,536 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029
2015-03-13 10:31:24,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:24,538 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030
2015-03-13 10:31:24,546 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:24,547 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030
2015-03-13 10:31:24,548 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031
2015-03-13 10:31:24,580 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0002_01_000001 succeeded
2015-03-13 10:31:24,581 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:31:24,581 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0002_01_000001
2015-03-13 10:31:24,589 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,591 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:31:24,592 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0002_01_000001 from application application_1426267835672_0002
2015-03-13 10:31:24,592 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:24,592 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0002
2015-03-13 10:31:24,741 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031
2015-03-13 10:31:24,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:24,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029
2015-03-13 10:31:24,885 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741836_1012]
2015-03-13 10:31:24,885 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741836_1012]
2015-03-13 10:31:24,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031
2015-03-13 10:31:25,120 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:25,228 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:31:25,228 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0002_01_000001
2015-03-13 10:31:25,228 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:25,229 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:25,229 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0002_000001
2015-03-13 10:31:25,229 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0002_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:31:25,230 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from FINISHING to FINISHED
2015-03-13 10:31:25,230 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0002 CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:25,230 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from FINISHING to FINISHED
2015-03-13 10:31:25,230 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:31:25,230 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0002
2015-03-13 10:31:25,230 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:31:25,230 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0002,name=[61C1702FCC0A429FBD628FD813F0535B/79C6C455F92F4DC7B488B1927023B72E] trap test/(2/2) ...atform/eacheverychain/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0002/jobhistory/job/job_1426267835672_0002,appMasterHost=Edinburgh.local,startTime=1426267864937,finishTime=1426267878526,finalStatus=SUCCEEDED
2015-03-13 10:31:25,231 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:25,231 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0002_000001
2015-03-13 10:31:25,231 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:25,231 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:31:25,231 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0002_000001 released container container_1426267835672_0002_01_000001 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:25,231 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0002_000001 is done. finalState=FINISHED
2015-03-13 10:31:25,232 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0002 requests cleared
2015-03-13 10:31:25,232 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0002 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:31:25,232 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0002 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:31:25,234 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:25,236 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0002_01_000001
2015-03-13 10:31:25,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,381 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,381 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,391 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:25,391 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0002
2015-03-13 10:31:25,391 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,392 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:25,392 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0002, with delay of 10800 seconds
2015-03-13 10:31:25,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:25,408 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:25,408 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,409 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,409 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,408 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0002
2015-03-13 10:31:25,409 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:25,410 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:25,410 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0002, with delay of 10800 seconds
2015-03-13 10:31:25,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:25,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:25,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:25,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:25,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:25,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:25,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:25,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:25,505 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:25,508 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000003 by user soberoi
2015-03-13 10:31:25,508 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000005 by user soberoi
2015-03-13 10:31:25,508 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000004 by user soberoi
2015-03-13 10:31:25,509 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:25,508 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0003
2015-03-13 10:31:25,509 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000005 to application application_1426267835672_0003
2015-03-13 10:31:25,508 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000002 by user soberoi
2015-03-13 10:31:25,509 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000004 to application application_1426267835672_0003
2015-03-13 10:31:25,510 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:25,510 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from NEW to INITING
2015-03-13 10:31:25,510 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000003 to application application_1426267835672_0003
2015-03-13 10:31:25,509 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:25,509 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:25,510 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000002 to application application_1426267835672_0003
2015-03-13 10:31:25,511 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from INITING to RUNNING
2015-03-13 10:31:25,511 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,512 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,513 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,513 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,513 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:25,513 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:25,513 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,513 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,513 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,514 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,514 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,514 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,514 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,514 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,515 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,515 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,515 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,515 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,515 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000003
2015-03-13 10:31:25,516 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000004
2015-03-13 10:31:25,516 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000005
2015-03-13 10:31:25,517 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000002
2015-03-13 10:31:25,534 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000003.tokens. Credentials list:
2015-03-13 10:31:25,535 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000002.tokens. Credentials list:
2015-03-13 10:31:25,534 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000004.tokens. Credentials list:
2015-03-13 10:31:25,535 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000005.tokens. Credentials list:
2015-03-13 10:31:25,550 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843 for deletion
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843 for deletion
2015-03-13 10:31:25,560 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842
2015-03-13 10:31:25,560 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843
2015-03-13 10:31:25,560 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836 for deletion
2015-03-13 10:31:25,560 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843
2015-03-13 10:31:25,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842
2015-03-13 10:31:25,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836
2015-03-13 10:31:25,560 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844 for deletion
2015-03-13 10:31:25,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845 for deletion
2015-03-13 10:31:25,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836 for deletion
2015-03-13 10:31:25,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844
2015-03-13 10:31:25,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845
2015-03-13 10:31:25,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836
2015-03-13 10:31:25,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002.tokens
2015-03-13 10:31:25,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:25,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:25,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:25,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar dst=null perm=null
2015-03-13 10:31:25,691 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52676, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1461837696_1865, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 640000
2015-03-13 10:31:25,710 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:25,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:25,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:25,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml dst=null perm=null
2015-03-13 10:31:25,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52676, bytes: 98938, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1461837696_1865, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 366000
2015-03-13 10:31:25,751 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:25,751 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,751 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,751 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,751 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,816 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,816 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,817 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,817 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,817 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,817 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,818 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,818 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,927 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002/default_container_executor.sh]
2015-03-13 10:31:25,927 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005/default_container_executor.sh]
2015-03-13 10:31:25,927 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004/default_container_executor.sh]
2015-03-13 10:31:25,928 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003/default_container_executor.sh]
2015-03-13 10:31:26,230 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,231 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:26,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0002
2015-03-13 10:31:26,233 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:26,233 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0002, with delay of 10800 seconds
2015-03-13 10:31:26,377 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,377 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,378 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,379 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,379 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,379 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,393 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:26,782 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:26,896 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005.tokens
2015-03-13 10:31:26,897 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:27,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:27,128 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004.tokens
2015-03-13 10:31:27,128 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:27,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:27,235 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003.tokens
2015-03-13 10:31:27,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:27,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,382 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,238 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,388 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,239 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,240 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,395 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,241 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:32,400 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,400 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,400 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:32,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52686, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000002_0_971355757_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 245000
2015-03-13 10:31:32,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:32,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split dst=null perm=null
2015-03-13 10:31:32,652 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52689, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000001_0_447082370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 215000
2015-03-13 10:31:32,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:32,691 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52691, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000002_0_971355757_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 196000
2015-03-13 10:31:32,693 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52690, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000003_0_-30378997_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 185000
2015-03-13 10:31:32,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52692, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000000_0_-1010613618_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 205000
2015-03-13 10:31:32,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:32,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:32,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:32,808 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52690, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000003_0_-30378997_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 251000
2015-03-13 10:31:32,811 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52693, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000000_0_-1010613618_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 168000
2015-03-13 10:31:33,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000002_0 dst=null perm=null
2015-03-13 10:31:33,101 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000004
2015-03-13 10:31:33,101 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:33,101 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,102 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000004
2015-03-13 10:31:33,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,115 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000004 is : 143
2015-03-13 10:31:33,117 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:33,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032 src: /127.0.0.1:52694 dest: /127.0.0.1:52451
2015-03-13 10:31:33,121 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032 src: /127.0.0.1:52695 dest: /127.0.0.1:52447
2015-03-13 10:31:33,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032 src: /127.0.0.1:52696 dest: /127.0.0.1:52444
2015-03-13 10:31:33,129 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist for DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:33,132 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,132 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,132 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,133 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,133 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:33,133 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,133 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000004 from application application_1426267835672_0003
2015-03-13 10:31:33,133 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,133 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:33,133 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,151 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52689, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000001_0_447082370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 244000
2015-03-13 10:31:33,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000001_0 dst=null perm=null
2015-03-13 10:31:33,198 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000003
2015-03-13 10:31:33,198 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:33,198 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,199 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000003
2015-03-13 10:31:33,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:33,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000004
2015-03-13 10:31:33,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,201 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:33,201 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:31:33,201 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:33,201 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:31:33,202 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:31:33,202 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,202 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,202 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:31:33,202 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000004 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:31:33,211 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000003 is : 143
2015-03-13 10:31:33,225 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,227 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:33,227 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,228 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000003 from application application_1426267835672_0003
2015-03-13 10:31:33,228 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,228 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:33,241 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000000_0 dst=null perm=null
2015-03-13 10:31:33,257 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000002
2015-03-13 10:31:33,258 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:33,258 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,258 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000002
2015-03-13 10:31:33,258 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,259 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:33,259 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000003
2015-03-13 10:31:33,259 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,260 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:33,260 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:31:33,260 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:33,260 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:31:33,260 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:31:33,260 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,260 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,261 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:31:33,261 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000003 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:33,271 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000002 is : 143
2015-03-13 10:31:33,284 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,284 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,285 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,285 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,286 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:33,286 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,286 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000002 from application application_1426267835672_0003
2015-03-13 10:31:33,286 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,286 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:33,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000003_0 dst=null perm=null
2015-03-13 10:31:33,299 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000005
2015-03-13 10:31:33,299 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:33,299 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,300 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000005
2015-03-13 10:31:33,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:33,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000002
2015-03-13 10:31:33,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,301 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:33,301 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:31:33,301 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:33,301 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:31:33,301 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:31:33,301 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,302 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,302 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:33,302 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000002 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:31:33,309 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000005 is : 143
2015-03-13 10:31:33,318 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,319 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,319 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,321 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:33,321 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,322 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000005 from application application_1426267835672_0003
2015-03-13 10:31:33,322 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,322 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:34,242 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:34,303 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:34,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000005
2015-03-13 10:31:34,304 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:34,305 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:31:34,305 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:34,305 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:34,305 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:34,306 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:34,306 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:34,306 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:34,306 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000005 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:35,243 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:35,245 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:35,245 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:35,245 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:31:35,245 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0003_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:35,245 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:35,246 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:35,438 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:35,448 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:35,451 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000006 by user soberoi
2015-03-13 10:31:35,451 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:35,451 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000006 to application application_1426267835672_0003
2015-03-13 10:31:35,452 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:31:35,452 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:35,452 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:35,452 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:35,452 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:35,453 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:35,478 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:35,478 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:35,544 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006/default_container_executor.sh]
2015-03-13 10:31:36,245 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:36,246 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:36,246 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:36,444 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:37,250 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:37,251 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:37,834 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 281 Total time for transactions(ms): 21 Number of transactions batched in Syncs: 3 Number of syncs: 144 SyncTimes(ms): 40 20
2015-03-13 10:31:37,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:37,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary dst=null perm=null
2015-03-13 10:31:37,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:37,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:37,897 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:37,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033 src: /127.0.0.1:52702 dest: /127.0.0.1:52454
2015-03-13 10:31:37,955 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033 src: /127.0.0.1:52703 dest: /127.0.0.1:52451
2015-03-13 10:31:37,956 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033 src: /127.0.0.1:52704 dest: /127.0.0.1:52444
2015-03-13 10:31:37,966 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52704, dest: /127.0.0.1:52444, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 8604000
2015-03-13 10:31:37,966 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:37,967 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:37,967 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52703, dest: /127.0.0.1:52451, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 9134000
2015-03-13 10:31:37,967 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:37,967 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:37,968 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52702, dest: /127.0.0.1:52454, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 10135000
2015-03-13 10:31:37,968 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:37,968 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:37,971 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1
2015-03-13 10:31:37,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:37,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:37,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:37,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:37,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:37,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:37,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:37,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:37,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:37,998 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1
2015-03-13 10:31:38,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:38,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0 dst=null perm=null
2015-03-13 10:31:38,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000 dst=null perm=null
2015-03-13 10:31:38,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:38,018 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000006
2015-03-13 10:31:38,018 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:38,018 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:31:38,018 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000006
2015-03-13 10:31:38,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:38,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:38,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,026 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,029 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000006 is : 143
2015-03-13 10:31:38,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1 dst=null perm=null
2015-03-13 10:31:38,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:38,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:38,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000 dst=null perm=null
2015-03-13 10:31:38,039 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:38,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000 dst=null perm=null
2015-03-13 10:31:38,040 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,039 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:38,040 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:38,040 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000006 from application application_1426267835672_0003
2015-03-13 10:31:38,040 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:38,040 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:38,039 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,039 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,040 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary dst=null perm=null
2015-03-13 10:31:38,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,052 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,056 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,069 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52696, dest: /127.0.0.1:52444, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 4944789000
2015-03-13 10:31:38,069 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,070 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,070 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52695, dest: /127.0.0.1:52447, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 4944489000
2015-03-13 10:31:38,070 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,071 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,071 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52694, dest: /127.0.0.1:52451, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 4946978000
2015-03-13 10:31:38,071 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,072 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,073 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,077 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:38,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034 src: /127.0.0.1:52705 dest: /127.0.0.1:52444
2015-03-13 10:31:38,081 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034 src: /127.0.0.1:52706 dest: /127.0.0.1:52454
2015-03-13 10:31:38,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034 src: /127.0.0.1:52707 dest: /127.0.0.1:52447
2015-03-13 10:31:38,085 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52707, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 1354000
2015-03-13 10:31:38,085 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,085 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,085 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52706, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 1781000
2015-03-13 10:31:38,086 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,086 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52705, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 2852000
2015-03-13 10:31:38,087 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,088 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,089 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist dst=null perm=null
2015-03-13 10:31:38,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:38,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist dst=null perm=null
2015-03-13 10:31:38,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:38,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist dst=null perm=null
2015-03-13 10:31:38,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,109 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52708, bytes: 60212, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 265000
2015-03-13 10:31:38,111 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:38,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035 src: /127.0.0.1:52709 dest: /127.0.0.1:52447
2015-03-13 10:31:38,115 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035 src: /127.0.0.1:52710 dest: /127.0.0.1:52451
2015-03-13 10:31:38,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035 src: /127.0.0.1:52711 dest: /127.0.0.1:52444
2015-03-13 10:31:38,119 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52711, dest: /127.0.0.1:52444, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, duration: 1701000
2015-03-13 10:31:38,120 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,120 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,120 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52710, dest: /127.0.0.1:52451, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, duration: 2432000
2015-03-13 10:31:38,121 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,121 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,121 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52709, dest: /127.0.0.1:52447, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, duration: 3726000
2015-03-13 10:31:38,122 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,122 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,123 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml dst=null perm=null
2015-03-13 10:31:38,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:38,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml dst=null perm=null
2015-03-13 10:31:38,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:38,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml dst=null perm=null
2015-03-13 10:31:38,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,138 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52712, bytes: 91469, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 371000
2015-03-13 10:31:38,140 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:38,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036 src: /127.0.0.1:52713 dest: /127.0.0.1:52444
2015-03-13 10:31:38,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036 src: /127.0.0.1:52714 dest: /127.0.0.1:52454
2015-03-13 10:31:38,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036 src: /127.0.0.1:52715 dest: /127.0.0.1:52447
2015-03-13 10:31:38,147 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52715, dest: /127.0.0.1:52447, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, duration: 1975000
2015-03-13 10:31:38,147 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,148 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52714, dest: /127.0.0.1:52454, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, duration: 2484000
2015-03-13 10:31:38,148 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,149 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52713, dest: /127.0.0.1:52444, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, duration: 3394000
2015-03-13 10:31:38,149 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,150 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,151 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,167 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:38,167 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0003
2015-03-13 10:31:38,167 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from RUNNING to REMOVING
2015-03-13 10:31:38,167 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0003
2015-03-13 10:31:38,167 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from REMOVING to FINISHING
2015-03-13 10:31:39,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:39,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:39,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000006
2015-03-13 10:31:39,021 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:39,022 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:31:39,022 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:39,022 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:31:39,022 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:39,023 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:39,023 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:39,023 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:39,023 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000006 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:39,179 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:31:39,179 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:31:39,179 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:31:39,179 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:31:39,180 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:31:39,180 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:31:39,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003 dst=null perm=null
2015-03-13 10:31:39,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,219 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary
2015-03-13 10:31:39,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary dst=null perm=null
2015-03-13 10:31:39,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,221 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary
2015-03-13 10:31:39,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary dst=null perm=null
2015-03-13 10:31:39,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary dst=null perm=null
2015-03-13 10:31:39,230 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,231 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:39,232 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:39,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,236 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:39,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000 dst=null perm=null
2015-03-13 10:31:39,245 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:39,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:39,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,252 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:39,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:39,255 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52717, bytes: 144, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 187000
2015-03-13 10:31:39,255 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everyaggregate/trap
2015-03-13 10:31:39,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap dst=null perm=null
2015-03-13 10:31:39,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:39,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:31:39,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52718, bytes: 144, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 203000
2015-03-13 10:31:39,262 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everyaggregate/tap
2015-03-13 10:31:39,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap dst=null perm=null
2015-03-13 10:31:39,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000 dst=null perm=null
2015-03-13 10:31:39,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000 dst=null perm=null
2015-03-13 10:31:39,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:39,286 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,289 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:31:39,289 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:31:39,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:39,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:39,305 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:31:39,306 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:31:39,306 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap"]
2015-03-13 10:31:39,306 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:31:39,306 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:31:39,306 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:31:39,307 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...-mr1/trapplatform/all/tap
2015-03-13 10:31:39,319 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:39,333 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:39,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:39,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:39,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:39,340 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 4
2015-03-13 10:31:39,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004 dst=null perm=null
2015-03-13 10:31:39,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:39,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:31:39,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:39,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,349 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:39,350 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52720 dest: /127.0.0.1:52447
2015-03-13 10:31:39,351 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52721 dest: /127.0.0.1:52454
2015-03-13 10:31:39,353 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52722 dest: /127.0.0.1:52451
2015-03-13 10:31:39,357 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52722, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 3011000
2015-03-13 10:31:39,358 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,358 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:39,358 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52721, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 3351000
2015-03-13 10:31:39,359 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:39,360 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52720, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 4865000
2015-03-13 10:31:39,360 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,361 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:39,363 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,364 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar
2015-03-13 10:31:39,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:39,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:39,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:39,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:39,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:39,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:39,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:39,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:39,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:39,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:39,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:39,378 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:39,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:39,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,385 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split
2015-03-13 10:31:39,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:39,391 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:39,392 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52723 dest: /127.0.0.1:52454
2015-03-13 10:31:39,394 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52724 dest: /127.0.0.1:52444
2015-03-13 10:31:39,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52725 dest: /127.0.0.1:52451
2015-03-13 10:31:39,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52726 dest: /127.0.0.1:52447
2015-03-13 10:31:39,401 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52726, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 2175000
2015-03-13 10:31:39,401 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,402 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,402 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52725, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 2884000
2015-03-13 10:31:39,402 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,403 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52724, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 4281000
2015-03-13 10:31:39,403 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,404 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52723, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 5175000
2015-03-13 10:31:39,405 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,405 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,407 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,407 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,409 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,416 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:39,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039 src: /127.0.0.1:52727 dest: /127.0.0.1:52447
2015-03-13 10:31:39,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039 src: /127.0.0.1:52728 dest: /127.0.0.1:52454
2015-03-13 10:31:39,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039 src: /127.0.0.1:52729 dest: /127.0.0.1:52444
2015-03-13 10:31:39,424 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52729, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 1527000
2015-03-13 10:31:39,424 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,425 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52728, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 2118000
2015-03-13 10:31:39,425 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,426 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,426 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52727, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 3211000
2015-03-13 10:31:39,426 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,426 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,431 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,431 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:31:39,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,437 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:39,438 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:39,445 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:39,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040 src: /127.0.0.1:52730 dest: /127.0.0.1:52447
2015-03-13 10:31:39,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040 src: /127.0.0.1:52731 dest: /127.0.0.1:52454
2015-03-13 10:31:39,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040 src: /127.0.0.1:52732 dest: /127.0.0.1:52444
2015-03-13 10:31:39,454 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52732, dest: /127.0.0.1:52444, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 4163000
2015-03-13 10:31:39,454 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,455 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,455 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52731, dest: /127.0.0.1:52454, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 4721000
2015-03-13 10:31:39,455 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,455 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,456 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52730, dest: /127.0.0.1:52447, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 5630000
2015-03-13 10:31:39,456 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,458 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,459 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0004
2015-03-13 10:31:39,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004 dst=null perm=null
2015-03-13 10:31:39,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:39,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:39,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:39,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:39,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:39,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:39,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:39,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:39,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:39,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:39,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:39,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:39,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:39,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:39,477 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 4 submitted by user soberoi
2015-03-13 10:31:39,477 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0004
2015-03-13 10:31:39,478 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0004
2015-03-13 10:31:39,478 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0004
2015-03-13 10:31:39,478 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from NEW to NEW_SAVING
2015-03-13 10:31:39,478 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:39,478 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0004_000001
2015-03-13 10:31:39,479 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:39,480 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0004 from user: soberoi activated in queue: default
2015-03-13 10:31:39,480 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0004 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:39,480 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:39,480 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0004 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:39,480 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0004_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:39,480 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:39,481 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:39,483 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0004/
2015-03-13 10:31:39,483 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0004
2015-03-13 10:31:39,483 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0004/
2015-03-13 10:31:39,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035
2015-03-13 10:31:39,753 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032
2015-03-13 10:31:39,754 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034
2015-03-13 10:31:39,754 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039
2015-03-13 10:31:39,755 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036
2015-03-13 10:31:39,756 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040
2015-03-13 10:31:39,756 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:39,770 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:39,771 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035
2015-03-13 10:31:39,772 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032
2015-03-13 10:31:39,773 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040
2015-03-13 10:31:39,773 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034
2015-03-13 10:31:39,774 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036
2015-03-13 10:31:39,775 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033
2015-03-13 10:31:39,775 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039
2015-03-13 10:31:39,901 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52454 to replicate blk_1073741861_1037 to datanode(s) 127.0.0.1:52444
2015-03-13 10:31:39,901 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741856_1032, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-03-13 10:31:39,901 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741856_1032, blk_1073741851_1027, blk_1073741852_1028, blk_1073741855_1031]
2015-03-13 10:31:39,958 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:39,997 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035
2015-03-13 10:31:39,997 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032
2015-03-13 10:31:40,023 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:40,025 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:40,025 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:31:40,025 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:31:40,026 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0004_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:40,026 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:40,027 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:40,027 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:40,027 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0004 AttemptId: appattempt_1426267835672_0004_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:31:40,028 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:40,028 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0004_000001
2015-03-13 10:31:40,028 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:40,029 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0004_000001
2015-03-13 10:31:40,029 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0004_000001
2015-03-13 10:31:40,029 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:31:40,032 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:31:40,034 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000001 by user soberoi
2015-03-13 10:31:40,034 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0004
2015-03-13 10:31:40,035 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:31:40,035 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from NEW to INITING
2015-03-13 10:31:40,035 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000001 to application application_1426267835672_0004
2015-03-13 10:31:40,035 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from INITING to RUNNING
2015-03-13 10:31:40,035 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0004_000001
2015-03-13 10:31:40,035 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:40,036 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:40,036 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:40,036 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,036 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,036 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,036 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,037 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000001
2015-03-13 10:31:40,046 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0004_01_000001.tokens. Credentials list:
2015-03-13 10:31:40,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:40,132 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034
2015-03-13 10:31:40,133 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040
2015-03-13 10:31:40,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:40,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033
2015-03-13 10:31:40,135 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036
2015-03-13 10:31:40,135 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039
2015-03-13 10:31:40,138 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001.tokens
2015-03-13 10:31:40,138 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:40,201 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:40,202 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033
2015-03-13 10:31:40,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:40,202 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:40,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:40,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:40,213 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52736, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 514000
2015-03-13 10:31:40,238 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:40,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:40,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:40,264 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52736, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 191000
2015-03-13 10:31:40,278 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:40,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:40,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:40,306 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52737, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 166000
2015-03-13 10:31:40,321 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,336 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:40,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:40,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:40,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:40,353 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52736, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 353000
2015-03-13 10:31:40,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,366 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:40,392 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:40,393 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:40,462 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001/default_container_executor.sh]
2015-03-13 10:31:40,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856 for deletion
2015-03-13 10:31:40,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:40,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:40,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853 for deletion
2015-03-13 10:31:40,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854 for deletion
2015-03-13 10:31:40,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855 for deletion
2015-03-13 10:31:40,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856
2015-03-13 10:31:40,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:40,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:40,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853
2015-03-13 10:31:40,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854
2015-03-13 10:31:40,578 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855
2015-03-13 10:31:40,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856 for deletion
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855 for deletion
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855
2015-03-13 10:31:40,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:40,938 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 to 127.0.0.1:52444
2015-03-13 10:31:40,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52738 dest: /127.0.0.1:52444
2015-03-13 10:31:40,941 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 (numBytes=254067) to /127.0.0.1:52444
2015-03-13 10:31:40,942 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52738 dest: /127.0.0.1:52444 of size 254067
2015-03-13 10:31:40,943 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741861_1037 size 254067
2015-03-13 10:31:41,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:41,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:41,028 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:42,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:42,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:42,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:42,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_STARTED dst=null perm=null
2015-03-13 10:31:42,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:31:42,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_FAIL dst=null perm=null
2015-03-13 10:31:42,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004 dst=null perm=null
2015-03-13 10:31:42,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:31:42,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:31:42,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:42,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:42,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52740, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 225000
2015-03-13 10:31:42,902 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030]
2015-03-13 10:31:42,902 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741856_1032, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-03-13 10:31:43,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:43,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:43,224 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:31:43,226 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0004_000001
2015-03-13 10:31:43,226 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0004 APPATTEMPTID=appattempt_1426267835672_0004_000001
2015-03-13 10:31:43,226 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:31:43,226 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from ACCEPTED to RUNNING
2015-03-13 10:31:43,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:43,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:43,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:43,435 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:43,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041 src: /127.0.0.1:52746 dest: /127.0.0.1:52444
2015-03-13 10:31:43,491 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041 src: /127.0.0.1:52747 dest: /127.0.0.1:52451
2015-03-13 10:31:43,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041 src: /127.0.0.1:52748 dest: /127.0.0.1:52454
2015-03-13 10:31:43,500 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52748, dest: /127.0.0.1:52454, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 5839000
2015-03-13 10:31:43,500 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:43,501 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:43,501 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52747, dest: /127.0.0.1:52451, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 6601000
2015-03-13 10:31:43,501 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:43,502 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:43,502 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52746, dest: /127.0.0.1:52444, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 7615000
2015-03-13 10:31:43,502 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:43,503 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:43,506 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:43,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856 for deletion
2015-03-13 10:31:43,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:43,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853 for deletion
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854 for deletion
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855 for deletion
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:43,583 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855
2015-03-13 10:31:43,584 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854
2015-03-13 10:31:43,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:43,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:43,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853 for deletion
2015-03-13 10:31:43,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854 for deletion
2015-03-13 10:31:43,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:43,937 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:43,938 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854
2015-03-13 10:31:43,938 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853
2015-03-13 10:31:44,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:44,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:44,309 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0003_01_000001 succeeded
2015-03-13 10:31:44,310 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:31:44,310 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000001
2015-03-13 10:31:44,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,319 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:44,319 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,319 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:31:44,319 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000001 from application application_1426267835672_0003
2015-03-13 10:31:44,319 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:44,320 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:44,331 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,331 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:44,331 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:44,331 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,332 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:31:44,332 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,332 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,332 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:44,332 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:31:44,333 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,333 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:31:44,333 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,333 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,333 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:44,334 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:31:44,334 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,334 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:31:44,334 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,334 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,334 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:44,335 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:31:44,335 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,335 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:31:44,335 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,781 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041
2015-03-13 10:31:44,981 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:45,052 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:31:45,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000001
2015-03-13 10:31:45,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:45,054 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:45,054 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0003_000001
2015-03-13 10:31:45,054 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from FINISHING to FINISHED
2015-03-13 10:31:45,054 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:31:45,055 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from FINISHING to FINISHED
2015-03-13 10:31:45,055 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0003 CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:45,055 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0003
2015-03-13 10:31:45,055 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0003,name=[A5DA9BA04876490E83B797AC0CE57F3F/1D775ED593824D6FA1483A7D4ADBD8AA] trap test/(1/1) ...atform/everyaggregate/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0003/jobhistory/job/job_1426267835672_0003,appMasterHost=Edinburgh.local,startTime=1426267879845,finishTime=1426267898167,finalStatus=SUCCEEDED
2015-03-13 10:31:45,055 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:31:45,055 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0003_000001
2015-03-13 10:31:45,055 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:31:45,056 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:45,056 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:45,056 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:31:45,056 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000001 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:45,056 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0003_000001 is done. finalState=FINISHED
2015-03-13 10:31:45,057 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0003 requests cleared
2015-03-13 10:31:45,057 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0003 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:31:45,057 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0003 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:31:45,059 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:45,060 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000001
2015-03-13 10:31:45,208 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041
2015-03-13 10:31:45,259 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,259 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,260 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,261 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:45,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:45,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:45,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:45,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:45,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:45,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:45,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:45,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:45,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:45,333 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:45,334 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0003
2015-03-13 10:31:45,334 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:45,334 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0003, with delay of 10800 seconds
2015-03-13 10:31:45,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,336 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,336 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,340 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041
2015-03-13 10:31:45,387 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:31:45,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000003 by user soberoi
2015-03-13 10:31:45,391 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000004 by user soberoi
2015-03-13 10:31:45,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000002 by user soberoi
2015-03-13 10:31:45,391 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:45,391 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:45,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000005 by user soberoi
2015-03-13 10:31:45,391 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000004 to application application_1426267835672_0004
2015-03-13 10:31:45,392 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000002 to application application_1426267835672_0004
2015-03-13 10:31:45,392 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000005 to application application_1426267835672_0004
2015-03-13 10:31:45,391 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0004
2015-03-13 10:31:45,391 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:45,392 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from NEW to INITING
2015-03-13 10:31:45,392 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000003 to application application_1426267835672_0004
2015-03-13 10:31:45,392 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:45,392 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from INITING to RUNNING
2015-03-13 10:31:45,393 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,393 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,393 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,394 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,394 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,394 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,394 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,394 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,394 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:45,394 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:45,394 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,395 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,395 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,395 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,396 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,396 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,396 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,396 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,396 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000002
2015-03-13 10:31:45,397 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000005
2015-03-13 10:31:45,400 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000004
2015-03-13 10:31:45,402 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000003
2015-03-13 10:31:45,420 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000002.tokens. Credentials list:
2015-03-13 10:31:45,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000005.tokens. Credentials list:
2015-03-13 10:31:45,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000003.tokens. Credentials list:
2015-03-13 10:31:45,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0004_01_000004.tokens. Credentials list:
2015-03-13 10:31:45,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:45,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002.tokens
2015-03-13 10:31:45,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:45,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:45,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:45,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar dst=null perm=null
2015-03-13 10:31:45,576 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52753, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_6864609_2341, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 540000
2015-03-13 10:31:45,594 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:45,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:45,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:45,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml dst=null perm=null
2015-03-13 10:31:45,618 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52754, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_6864609_2341, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 338000
2015-03-13 10:31:45,631 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:45,631 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,631 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,631 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,631 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,679 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,679 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,686 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,686 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,686 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,686 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,693 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,693 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,784 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005/default_container_executor.sh]
2015-03-13 10:31:45,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003/default_container_executor.sh]
2015-03-13 10:31:45,790 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004/default_container_executor.sh]
2015-03-13 10:31:45,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002/default_container_executor.sh]
2015-03-13 10:31:46,057 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,058 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:46,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,058 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0003
2015-03-13 10:31:46,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,058 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:46,058 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0003, with delay of 10800 seconds
2015-03-13 10:31:46,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,275 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:46,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,337 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,337 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,337 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,337 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,338 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,338 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:46,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004.tokens
2015-03-13 10:31:46,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:46,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:47,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005.tokens
2015-03-13 10:31:47,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:47,059 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:47,235 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003.tokens
2015-03-13 10:31:47,235 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:47,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,064 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,066 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,343 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,345 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,066 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,346 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,069 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:52,074 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:52,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:52,277 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52765, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 181000
2015-03-13 10:31:52,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split dst=null perm=null
2015-03-13 10:31:52,357 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,358 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,358 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,358 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,369 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52767, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 190000
2015-03-13 10:31:52,374 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52768, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 241000
2015-03-13 10:31:52,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:52,413 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52765, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 201000
2015-03-13 10:31:52,452 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52769, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 183000
2015-03-13 10:31:52,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:52,477 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52770, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 243000
2015-03-13 10:31:52,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:52,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:52,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52771, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 205000
2015-03-13 10:31:52,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:52,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:52,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,845 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:52,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:52,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042 src: /127.0.0.1:52772 dest: /127.0.0.1:52451
2015-03-13 10:31:52,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042 src: /127.0.0.1:52773 dest: /127.0.0.1:52447
2015-03-13 10:31:52,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042 src: /127.0.0.1:52774 dest: /127.0.0.1:52454
2015-03-13 10:31:52,910 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52774, dest: /127.0.0.1:52454, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 8521000
2015-03-13 10:31:52,910 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:52,910 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:52,910 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52773, dest: /127.0.0.1:52447, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 8415000
2015-03-13 10:31:52,911 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:52,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:52,911 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52772, dest: /127.0.0.1:52451, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 10099000
2015-03-13 10:31:52,911 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:52,912 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:52,917 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1
2015-03-13 10:31:52,919 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52775, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 222000
2015-03-13 10:31:52,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:52,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:52,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003 dst=null perm=null
2015-03-13 10:31:52,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000003_0 dst=null perm=null
2015-03-13 10:31:52,995 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000005
2015-03-13 10:31:52,995 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:52,995 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:31:52,995 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000005
2015-03-13 10:31:52,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:53,000 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:53,009 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000005 is : 143
2015-03-13 10:31:53,011 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:53,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044 src: /127.0.0.1:52777 dest: /127.0.0.1:52444
2015-03-13 10:31:53,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044 src: /127.0.0.1:52778 dest: /127.0.0.1:52447
2015-03-13 10:31:53,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044 src: /127.0.0.1:52779 dest: /127.0.0.1:52454
2015-03-13 10:31:53,024 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist for DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:53,025 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000005 from application application_1426267835672_0004
2015-03-13 10:31:53,027 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,027 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:53,051 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:53,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043 src: /127.0.0.1:52776 dest: /127.0.0.1:52447
2015-03-13 10:31:53,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043 src: /127.0.0.1:52781 dest: /127.0.0.1:52451
2015-03-13 10:31:53,059 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043 src: /127.0.0.1:52782 dest: /127.0.0.1:52444
2015-03-13 10:31:53,071 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52782, dest: /127.0.0.1:52444, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 10982000
2015-03-13 10:31:53,072 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:53,072 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,072 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52781, dest: /127.0.0.1:52451, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 8337000
2015-03-13 10:31:53,072 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,073 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,073 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52776, dest: /127.0.0.1:52447, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 9712000
2015-03-13 10:31:53,073 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,074 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,078 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,083 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1
2015-03-13 10:31:53,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045 src: /127.0.0.1:52780 dest: /127.0.0.1:52447
2015-03-13 10:31:53,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045 src: /127.0.0.1:52783 dest: /127.0.0.1:52454
2015-03-13 10:31:53,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045 src: /127.0.0.1:52784 dest: /127.0.0.1:52444
2015-03-13 10:31:53,121 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52784, dest: /127.0.0.1:52444, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 7443000
2015-03-13 10:31:53,121 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:53,122 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,122 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52783, dest: /127.0.0.1:52454, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 7399000
2015-03-13 10:31:53,122 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,122 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,123 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52780, dest: /127.0.0.1:52447, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 9647000
2015-03-13 10:31:53,123 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,123 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,128 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1
2015-03-13 10:31:53,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:53,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:53,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:53,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:53,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000 dst=null perm=null
2015-03-13 10:31:53,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000001_0 dst=null perm=null
2015-03-13 10:31:53,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000000_0 dst=null perm=null
2015-03-13 10:31:53,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,202 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000003
2015-03-13 10:31:53,202 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:53,202 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:31:53,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,202 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000003
2015-03-13 10:31:53,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:53,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000005
2015-03-13 10:31:53,204 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:53,204 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:31:53,204 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:53,204 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:31:53,204 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:31:53,205 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,205 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,205 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:31:53,206 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000005 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:31:53,217 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000003 is : 143
2015-03-13 10:31:53,230 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,231 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000002
2015-03-13 10:31:53,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,231 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:53,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,233 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:31:53,233 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:53,233 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,234 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000002
2015-03-13 10:31:53,246 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000002 is : 143
2015-03-13 10:31:53,259 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000003 from application application_1426267835672_0004
2015-03-13 10:31:53,259 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,259 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:53,259 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,260 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,260 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:53,260 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,261 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,262 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,262 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:53,262 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,263 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000002 from application application_1426267835672_0004
2015-03-13 10:31:53,263 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,263 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:53,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046 src: /127.0.0.1:52785 dest: /127.0.0.1:52451
2015-03-13 10:31:53,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046 src: /127.0.0.1:52786 dest: /127.0.0.1:52454
2015-03-13 10:31:53,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046 src: /127.0.0.1:52787 dest: /127.0.0.1:52444
2015-03-13 10:31:53,313 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52787, dest: /127.0.0.1:52444, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 8183000
2015-03-13 10:31:53,313 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:53,314 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,314 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52786, dest: /127.0.0.1:52454, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 8976000
2015-03-13 10:31:53,314 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,314 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,314 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52785, dest: /127.0.0.1:52451, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 9821000
2015-03-13 10:31:53,315 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,315 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,319 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1
2015-03-13 10:31:53,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:53,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002 dst=null perm=null
2015-03-13 10:31:53,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000002_0 dst=null perm=null
2015-03-13 10:31:53,400 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000004
2015-03-13 10:31:53,400 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:53,400 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:31:53,401 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000004
2015-03-13 10:31:53,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000002
2015-03-13 10:31:53,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000003
2015-03-13 10:31:53,402 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:53,402 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:53,402 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:31:53,402 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:53,403 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:31:53,403 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:31:53,403 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,403 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,403 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:31:53,403 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000002 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:53,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:53,403 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:31:53,404 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:53,404 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:31:53,404 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:31:53,404 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,404 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,404 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:53,404 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000003 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:31:53,413 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000004 is : 143
2015-03-13 10:31:53,426 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,428 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:53,429 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,430 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000004 from application application_1426267835672_0004
2015-03-13 10:31:53,430 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,430 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:54,079 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:54,403 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:54,403 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000004
2015-03-13 10:31:54,403 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:54,403 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:31:54,403 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:54,404 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:54,404 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:54,404 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,404 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,404 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:54,404 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000004 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:54,405 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:54,405 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:54,405 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:54,405 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,405 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:54,405 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,974 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045
2015-03-13 10:31:54,974 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042
2015-03-13 10:31:54,975 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043
2015-03-13 10:31:54,988 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045
2015-03-13 10:31:54,989 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046
2015-03-13 10:31:54,989 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043
2015-03-13 10:31:55,084 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:55,212 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046
2015-03-13 10:31:55,212 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043
2015-03-13 10:31:55,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042
2015-03-13 10:31:55,313 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:55,322 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000006 by user soberoi
2015-03-13 10:31:55,322 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:55,322 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000006 to application application_1426267835672_0004
2015-03-13 10:31:55,322 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:31:55,323 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:55,323 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:55,323 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:55,323 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:55,324 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:55,347 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045
2015-03-13 10:31:55,347 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046
2015-03-13 10:31:55,347 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042
2015-03-13 10:31:55,348 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:55,348 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:55,407 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:55,408 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:55,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006/default_container_executor.sh]
2015-03-13 10:31:56,089 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:56,321 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:31:56,409 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:57,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:57,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:57,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,742 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0004_r_000000_0_-2143487595_1
2015-03-13 10:31:57,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0 dst=null perm=null
2015-03-13 10:31:57,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0 dst=null perm=null
2015-03-13 10:31:57,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000 dst=null perm=null
2015-03-13 10:31:57,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:57,767 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000006
2015-03-13 10:31:57,768 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:57,768 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:31:57,768 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000006
2015-03-13 10:31:57,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:57,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,777 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,780 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000006 is : 143
2015-03-13 10:31:57,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1 dst=null perm=null
2015-03-13 10:31:57,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:57,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:57,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000 dst=null perm=null
2015-03-13 10:31:57,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000 dst=null perm=null
2015-03-13 10:31:57,789 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:57,789 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:57,790 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000006 from application application_1426267835672_0004
2015-03-13 10:31:57,790 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:57,790 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:57,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary dst=null perm=null
2015-03-13 10:31:57,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,800 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,805 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,817 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52779, dest: /127.0.0.1:52454, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 4796714000
2015-03-13 10:31:57,817 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,818 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:57,818 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52778, dest: /127.0.0.1:52447, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 4797607000
2015-03-13 10:31:57,819 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,819 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:57,820 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52777, dest: /127.0.0.1:52444, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 4798979000
2015-03-13 10:31:57,820 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,820 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:57,822 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,826 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:57,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047 src: /127.0.0.1:52792 dest: /127.0.0.1:52447
2015-03-13 10:31:57,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047 src: /127.0.0.1:52793 dest: /127.0.0.1:52454
2015-03-13 10:31:57,830 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047 src: /127.0.0.1:52794 dest: /127.0.0.1:52451
2015-03-13 10:31:57,833 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52794, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 1366000
2015-03-13 10:31:57,833 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,834 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:57,834 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52793, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 1902000
2015-03-13 10:31:57,834 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,835 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:57,835 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52792, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 2884000
2015-03-13 10:31:57,835 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,836 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:57,837 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist dst=null perm=null
2015-03-13 10:31:57,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:57,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist dst=null perm=null
2015-03-13 10:31:57,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:31:57,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist dst=null perm=null
2015-03-13 10:31:57,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52795, bytes: 58236, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 221000
2015-03-13 10:31:57,855 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:57,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048 src: /127.0.0.1:52796 dest: /127.0.0.1:52451
2015-03-13 10:31:57,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048 src: /127.0.0.1:52797 dest: /127.0.0.1:52444
2015-03-13 10:31:57,859 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048 src: /127.0.0.1:52798 dest: /127.0.0.1:52447
2015-03-13 10:31:57,862 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52798, dest: /127.0.0.1:52447, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, duration: 1642000
2015-03-13 10:31:57,862 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,863 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:57,863 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52797, dest: /127.0.0.1:52444, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, duration: 2198000
2015-03-13 10:31:57,863 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,863 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:57,864 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52796, dest: /127.0.0.1:52451, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, duration: 3741000
2015-03-13 10:31:57,865 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,865 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:57,867 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml dst=null perm=null
2015-03-13 10:31:57,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:57,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml dst=null perm=null
2015-03-13 10:31:57,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp dst=null perm=null
2015-03-13 10:31:57,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml dst=null perm=null
2015-03-13 10:31:57,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52799, bytes: 91498, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 410000
2015-03-13 10:31:57,881 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:57,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049 src: /127.0.0.1:52800 dest: /127.0.0.1:52454
2015-03-13 10:31:57,884 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049 src: /127.0.0.1:52801 dest: /127.0.0.1:52451
2015-03-13 10:31:57,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049 src: /127.0.0.1:52802 dest: /127.0.0.1:52444
2015-03-13 10:31:57,889 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52802, dest: /127.0.0.1:52444, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, duration: 1866000
2015-03-13 10:31:57,889 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,890 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:57,890 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52801, dest: /127.0.0.1:52451, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, duration: 2425000
2015-03-13 10:31:57,890 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,891 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:57,891 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52800, dest: /127.0.0.1:52454, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, duration: 3446000
2015-03-13 10:31:57,891 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,892 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:57,894 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,908 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:57,908 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0004
2015-03-13 10:31:57,908 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from RUNNING to REMOVING
2015-03-13 10:31:57,909 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0004
2015-03-13 10:31:57,909 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from REMOVING to FINISHING
2015-03-13 10:31:58,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:58,772 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:58,772 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000006
2015-03-13 10:31:58,773 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:58,773 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:31:58,773 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:58,773 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:58,773 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:58,774 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:58,774 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:58,774 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:58,774 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000006 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:58,915 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741861_1037 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444
2015-03-13 10:31:58,915 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741862_1038 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447
2015-03-13 10:31:58,916 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741863_1039 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:31:58,916 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741864_1040 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:31:58,916 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741868_1044 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:31:58,916 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741865_1041 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454
2015-03-13 10:31:58,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004 dst=null perm=null
2015-03-13 10:31:58,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,947 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary
2015-03-13 10:31:58,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary dst=null perm=null
2015-03-13 10:31:58,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:58,949 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary
2015-03-13 10:31:58,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:58,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:58,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:58,951 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary
2015-03-13 10:31:58,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary dst=null perm=null
2015-03-13 10:31:58,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:58,960 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:58,961 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:58,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,964 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:58,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000 dst=null perm=null
2015-03-13 10:31:58,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:58,975 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:58,976 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:58,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:58,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:58,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:58,980 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:31:58,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:31:58,983 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52804, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 198000
2015-03-13 10:31:58,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:58,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 204000
2015-03-13 10:31:58,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:31:58,989 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 159000
2015-03-13 10:31:58,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:31:58,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 180000
2015-03-13 10:31:58,991 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/all/tap
2015-03-13 10:31:58,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap dst=null perm=null
2015-03-13 10:31:58,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000 dst=null perm=null
2015-03-13 10:31:58,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000 dst=null perm=null
2015-03-13 10:31:58,998 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/all/trap
2015-03-13 10:31:58,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:58,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:59,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:59,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap dst=null perm=null
2015-03-13 10:31:59,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:31:59,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:31:59,005 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52806, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 208000
2015-03-13 10:31:59,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:59,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:31:59,009 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 192000
2015-03-13 10:31:59,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:31:59,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:31:59,014 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 194000
2015-03-13 10:31:59,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:31:59,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:31:59,018 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 178000
2015-03-13 10:31:59,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:59,033 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:59,034 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:31:59,035 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:31:59,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:31:59,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:31:59,048 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:31:59,048 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["HadoopFailScheme[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:31:59,048 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["HadoopFailScheme[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink"]
2015-03-13 10:31:59,049 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:31:59,049 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:31:59,049 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:31:59,049 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...tform/trapsourcesink/sink
2015-03-13 10:31:59,057 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:59,068 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:59,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:31:59,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:59,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:31:59,074 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 5
2015-03-13 10:31:59,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005 dst=null perm=null
2015-03-13 10:31:59,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:59,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:31:59,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,081 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:59,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52809 dest: /127.0.0.1:52447
2015-03-13 10:31:59,083 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52810 dest: /127.0.0.1:52451
2015-03-13 10:31:59,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52811 dest: /127.0.0.1:52444
2015-03-13 10:31:59,089 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52811, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 2970000
2015-03-13 10:31:59,089 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,090 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:59,090 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52810, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 3548000
2015-03-13 10:31:59,090 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,090 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:59,091 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52809, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 4768000
2015-03-13 10:31:59,091 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,092 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:59,093 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,093 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar
2015-03-13 10:31:59,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,094 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:59,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:59,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:59,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:59,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:31:59,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:31:59,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:31:59,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:31:59,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:31:59,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:59,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:59,102 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:59,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:31:59,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,107 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split
2015-03-13 10:31:59,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:31:59,108 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:59,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52812 dest: /127.0.0.1:52444
2015-03-13 10:31:59,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52813 dest: /127.0.0.1:52454
2015-03-13 10:31:59,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52814 dest: /127.0.0.1:52451
2015-03-13 10:31:59,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52815 dest: /127.0.0.1:52447
2015-03-13 10:31:59,118 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52815, dest: /127.0.0.1:52447, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 2565000
2015-03-13 10:31:59,119 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,119 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,119 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52814, dest: /127.0.0.1:52451, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 2997000
2015-03-13 10:31:59,119 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,120 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,120 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52813, dest: /127.0.0.1:52454, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 4076000
2015-03-13 10:31:59,120 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,121 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52812, dest: /127.0.0.1:52444, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 4652000
2015-03-13 10:31:59,121 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,121 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,121 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,123 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,128 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:59,129 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052 src: /127.0.0.1:52816 dest: /127.0.0.1:52451
2015-03-13 10:31:59,131 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052 src: /127.0.0.1:52817 dest: /127.0.0.1:52447
2015-03-13 10:31:59,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052 src: /127.0.0.1:52818 dest: /127.0.0.1:52454
2015-03-13 10:31:59,135 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52818, dest: /127.0.0.1:52454, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 1307000
2015-03-13 10:31:59,135 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,136 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:59,136 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52817, dest: /127.0.0.1:52447, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 1884000
2015-03-13 10:31:59,136 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,137 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:59,137 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52816, dest: /127.0.0.1:52451, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 2973000
2015-03-13 10:31:59,137 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,138 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:59,139 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,139 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:31:59,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,143 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:59,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:59,144 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:59,179 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:59,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053 src: /127.0.0.1:52819 dest: /127.0.0.1:52447
2015-03-13 10:31:59,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053 src: /127.0.0.1:52820 dest: /127.0.0.1:52444
2015-03-13 10:31:59,183 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053 src: /127.0.0.1:52821 dest: /127.0.0.1:52451
2015-03-13 10:31:59,189 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52821, dest: /127.0.0.1:52451, bytes: 98092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 4661000
2015-03-13 10:31:59,190 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,190 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:59,190 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52820, dest: /127.0.0.1:52444, bytes: 98092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 5145000
2015-03-13 10:31:59,190 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,191 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:59,191 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52819, dest: /127.0.0.1:52447, bytes: 98092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 5976000
2015-03-13 10:31:59,191 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,192 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:59,193 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,194 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0005
2015-03-13 10:31:59,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005 dst=null perm=null
2015-03-13 10:31:59,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:31:59,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:31:59,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:31:59,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:31:59,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:59,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:59,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:59,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:59,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:59,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:59,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:31:59,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:31:59,207 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 5 submitted by user soberoi
2015-03-13 10:31:59,207 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0005
2015-03-13 10:31:59,207 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0005
2015-03-13 10:31:59,207 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0005
2015-03-13 10:31:59,207 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from NEW to NEW_SAVING
2015-03-13 10:31:59,208 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:59,208 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,208 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:59,208 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0005 from user: soberoi activated in queue: default
2015-03-13 10:31:59,208 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0005 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:59,208 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0005 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:59,209 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0005_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:59,209 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0005 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:59,209 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:59,209 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:59,211 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0005/
2015-03-13 10:31:59,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0005
2015-03-13 10:31:59,212 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0005/
2015-03-13 10:31:59,479 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:59,480 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:31:59,480 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:31:59,480 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0005 container=Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0005_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:59,480 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:59,480 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:59,480 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:59,481 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0005 AttemptId: appattempt_1426267835672_0005_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ]
2015-03-13 10:31:59,482 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:59,482 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,482 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:59,483 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0005_000001
2015-03-13 10:31:59,483 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,484 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:31:59,486 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:31:59,488 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0005_01_000001 by user soberoi
2015-03-13 10:31:59,488 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0005
2015-03-13 10:31:59,489 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:31:59,489 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from NEW to INITING
2015-03-13 10:31:59,489 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0005_01_000001 to application application_1426267835672_0005
2015-03-13 10:31:59,489 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from INITING to RUNNING
2015-03-13 10:31:59,489 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,489 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:59,489 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:59,490 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0005
2015-03-13 10:31:59,490 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0005_01_000001
2015-03-13 10:31:59,499 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0005_01_000001.tokens. Credentials list:
2015-03-13 10:31:59,515 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:59,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001.tokens
2015-03-13 10:31:59,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:31:59,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:31:59,659 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52804, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 515000
2015-03-13 10:31:59,678 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:59,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:59,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:31:59,700 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52804, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 177000
2015-03-13 10:31:59,713 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:31:59,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:31:59,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:31:59,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 370, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 173000
2015-03-13 10:31:59,748 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:31:59,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:31:59,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:31:59,771 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 98860, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 311000
2015-03-13 10:31:59,783 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,783 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:59,811 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:59,811 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:59,877 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001/default_container_executor.sh]
2015-03-13 10:31:59,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044
2015-03-13 10:31:59,978 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048
2015-03-13 10:31:59,978 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047
2015-03-13 10:31:59,979 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053
2015-03-13 10:31:59,979 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052
2015-03-13 10:31:59,994 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:00,095 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:00,198 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048
2015-03-13 10:32:00,199 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049
2015-03-13 10:32:00,199 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044
2015-03-13 10:32:00,200 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,219 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047
2015-03-13 10:32:00,219 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053
2015-03-13 10:32:00,220 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049
2015-03-13 10:32:00,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049
2015-03-13 10:32:00,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052
2015-03-13 10:32:00,354 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044
2015-03-13 10:32:00,354 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047
2015-03-13 10:32:00,355 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,379 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:00,379 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,394 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053
2015-03-13 10:32:00,419 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048
2015-03-13 10:32:00,479 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:00,480 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:00,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:00,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052
2015-03-13 10:32:00,621 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,912 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741874_1050 to datanode(s) 127.0.0.1:52454
2015-03-13 10:32:00,912 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741868_1044]
2015-03-13 10:32:00,912 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041, blk_1073741868_1044]
2015-03-13 10:32:01,097 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:01,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:01,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_STARTED dst=null perm=null
2015-03-13 10:32:01,483 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:01,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:32:01,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_FAIL dst=null perm=null
2015-03-13 10:32:01,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005 dst=null perm=null
2015-03-13 10:32:01,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:32:01,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:32:01,603 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:01,603 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:01,603 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863 for deletion
2015-03-13 10:32:01,603 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864 for deletion
2015-03-13 10:32:01,604 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868 for deletion
2015-03-13 10:32:01,604 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:01,604 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863
2015-03-13 10:32:01,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:01,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864
2015-03-13 10:32:01,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868
2015-03-13 10:32:01,606 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 to 127.0.0.1:52454
2015-03-13 10:32:01,606 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:01,606 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:01,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863 for deletion
2015-03-13 10:32:01,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864 for deletion
2015-03-13 10:32:01,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865 for deletion
2015-03-13 10:32:01,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868 for deletion
2015-03-13 10:32:01,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:01,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864
2015-03-13 10:32:01,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865
2015-03-13 10:32:01,609 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:32:01,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:01,610 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863
2015-03-13 10:32:01,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868
2015-03-13 10:32:01,611 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52826 dest: /127.0.0.1:52454
2015-03-13 10:32:01,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52826 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:32:01,614 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741874_1050 size 254067
2015-03-13 10:32:01,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:01,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:01,880 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52827, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 207000
2015-03-13 10:32:02,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:02,487 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:02,633 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:32:02,635 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0005_000001
2015-03-13 10:32:02,635 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0005 APPATTEMPTID=appattempt_1426267835672_0005_000001
2015-03-13 10:32:02,635 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:02,635 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from ACCEPTED to RUNNING
2015-03-13 10:32:02,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:02,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:02,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:02,854 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:02,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054 src: /127.0.0.1:52833 dest: /127.0.0.1:52451
2015-03-13 10:32:02,893 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054 src: /127.0.0.1:52834 dest: /127.0.0.1:52447
2015-03-13 10:32:02,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054 src: /127.0.0.1:52835 dest: /127.0.0.1:52444
2015-03-13 10:32:02,902 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52835, dest: /127.0.0.1:52444, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 5962000
2015-03-13 10:32:02,902 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:02,903 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:02,903 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52834, dest: /127.0.0.1:52447, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 6614000
2015-03-13 10:32:02,903 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:02,904 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52833, dest: /127.0.0.1:52451, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 7611000
2015-03-13 10:32:02,904 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:02,904 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:02,905 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:02,911 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:03,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:03,492 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:03,794 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:03,794 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:03,795 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:03,795 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0005 container=Container: [ContainerId: container_1426267835672_0005_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0005_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:03,795 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:03,795 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:03,917 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741865_1041]
2015-03-13 10:32:03,918 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041, blk_1073741868_1044]
2015-03-13 10:32:04,050 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0004_01_000001 succeeded
2015-03-13 10:32:04,050 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:04,050 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000001
2015-03-13 10:32:04,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:04,059 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000001 from application application_1426267835672_0004
2015-03-13 10:32:04,059 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:04,059 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:32:04,108 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:04,108 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000001
2015-03-13 10:32:04,109 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:04,109 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0004_000001
2015-03-13 10:32:04,109 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:04,109 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:04,109 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0004 CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:32:04,110 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from FINISHING to FINISHED
2015-03-13 10:32:04,110 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:04,110 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0004
2015-03-13 10:32:04,110 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:32:04,110 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0004,name=[556A3EF415294468966B68292BE360F8/1F24603F771643C9A3DB4171C3FE2709] trap test/(1/1) ...-mr1/trapplatform/all/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0004/jobhistory/job/job_1426267835672_0004,appMasterHost=Edinburgh.local,startTime=1426267899477,finishTime=1426267917909,finalStatus=SUCCEEDED
2015-03-13 10:32:04,111 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0004_000001
2015-03-13 10:32:04,111 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:04,111 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:04,111 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:32:04,111 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000001 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:04,112 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0004_000001 is done. finalState=FINISHED
2015-03-13 10:32:04,112 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0004 requests cleared
2015-03-13 10:32:04,112 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0004 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:04,112 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0004 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:04,114 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:32:04,116 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000001
2015-03-13 10:32:04,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:04,666 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:04,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:32:04,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:32:04,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:32:04,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:32:04,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:04,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:04,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:04,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:04,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:04,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:04,778 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:32:04,781 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0005_01_000002 by user soberoi
2015-03-13 10:32:04,781 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0005
2015-03-13 10:32:04,781 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:04,781 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from NEW to INITING
2015-03-13 10:32:04,781 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0005_01_000002 to application application_1426267835672_0005
2015-03-13 10:32:04,782 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from INITING to RUNNING
2015-03-13 10:32:04,782 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:04,782 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0005
2015-03-13 10:32:04,782 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0005
2015-03-13 10:32:04,782 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:04,782 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0005
2015-03-13 10:32:04,783 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:04,783 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:04,783 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0005_01_000002
2015-03-13 10:32:04,793 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0005_01_000002.tokens. Credentials list:
2015-03-13 10:32:04,794 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:04,794 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:04,794 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:04,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,795 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0004
2015-03-13 10:32:04,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,795 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,796 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,795 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:04,796 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0004, with delay of 10800 seconds
2015-03-13 10:32:04,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:04,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:04,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865 for deletion
2015-03-13 10:32:04,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:04,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:04,811 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:04,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865
2015-03-13 10:32:04,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0005_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002.tokens
2015-03-13 10:32:04,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:04,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:32:04,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:32:04,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar dst=null perm=null
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863 for deletion
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864 for deletion
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865 for deletion
2015-03-13 10:32:04,955 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868 for deletion
2015-03-13 10:32:04,954 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863
2015-03-13 10:32:04,955 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864
2015-03-13 10:32:04,955 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865
2015-03-13 10:32:04,955 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868
2015-03-13 10:32:04,956 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52840, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1229307756_2825, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 520000
2015-03-13 10:32:04,974 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:04,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:32:04,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:32:04,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml dst=null perm=null
2015-03-13 10:32:04,998 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52841, bytes: 98860, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1229307756_2825, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 319000
2015-03-13 10:32:05,011 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:05,011 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:05,036 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:05,036 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:05,104 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002/default_container_executor.sh]
2015-03-13 10:32:05,109 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:05,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,110 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0004
2015-03-13 10:32:05,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,110 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:05,110 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0004, with delay of 10800 seconds
2015-03-13 10:32:05,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:05,383 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054
2015-03-13 10:32:05,400 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054
2015-03-13 10:32:05,497 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:05,624 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054
2015-03-13 10:32:05,681 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:32:05,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:06,502 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:06,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:07,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split dst=null perm=null
2015-03-13 10:32:07,265 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52844, bytes: 370, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 153000
2015-03-13 10:32:07,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:07,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary dst=null perm=null
2015-03-13 10:32:07,504 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:07,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:07,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:07,688 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52844, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 189000
2015-03-13 10:32:07,698 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:07,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055 src: /127.0.0.1:52845 dest: /127.0.0.1:52447
2015-03-13 10:32:07,730 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055 src: /127.0.0.1:52846 dest: /127.0.0.1:52451
2015-03-13 10:32:07,731 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055 src: /127.0.0.1:52847 dest: /127.0.0.1:52454
2015-03-13 10:32:07,737 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52847, dest: /127.0.0.1:52454, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 4410000
2015-03-13 10:32:07,737 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:07,738 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52846, dest: /127.0.0.1:52451, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 5149000
2015-03-13 10:32:07,738 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:07,738 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:07,740 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52845, dest: /127.0.0.1:52447, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 6648000
2015-03-13 10:32:07,740 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:07,741 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:07,742 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:07,745 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1
2015-03-13 10:32:07,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:07,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:07,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:07,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_m_000000_0 dst=null perm=null
2015-03-13 10:32:07,804 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:07,806 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0005_01_000002
2015-03-13 10:32:07,807 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:07,807 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:32:07,807 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0005_01_000002
2015-03-13 10:32:07,807 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:07,820 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0005_01_000002 is : 143
2015-03-13 10:32:07,824 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:07,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056 src: /127.0.0.1:52848 dest: /127.0.0.1:52447
2015-03-13 10:32:07,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056 src: /127.0.0.1:52849 dest: /127.0.0.1:52454
2015-03-13 10:32:07,830 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056 src: /127.0.0.1:52850 dest: /127.0.0.1:52444
2015-03-13 10:32:07,833 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:07,833 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:07,835 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:07,835 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0005_01_000002 from application application_1426267835672_0005
2015-03-13 10:32:07,835 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:07,835 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0005
2015-03-13 10:32:07,836 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist for DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:08,509 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:08,810 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:08,810 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0005_01_000002
2015-03-13 10:32:08,811 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:08,811 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0005_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:32:08,812 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:08,812 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:08,812 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:08,812 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0005_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:08,812 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:08,813 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:08,813 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0005_000001 released container container_1426267835672_0005_01_000002 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:09,511 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:09,812 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:09,813 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:09,813 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:09,813 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0005 container=Container: [ContainerId: container_1426267835672_0005_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0005_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:09,813 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:09,813 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:10,364 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055
2015-03-13 10:32:10,389 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055
2015-03-13 10:32:10,512 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:10,627 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055
2015-03-13 10:32:10,710 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:10,718 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0005_01_000003 by user soberoi
2015-03-13 10:32:10,719 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:10,719 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0005_01_000003 to application application_1426267835672_0005
2015-03-13 10:32:10,719 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:10,719 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0005
2015-03-13 10:32:10,719 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0005
2015-03-13 10:32:10,719 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:10,719 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0005
2015-03-13 10:32:10,720 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:10,745 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:10,745 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:10,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:10,813 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:10,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003/default_container_executor.sh]
2015-03-13 10:32:11,515 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:11,716 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:32:11,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:12,516 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:12,819 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:13,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary dst=null perm=null
2015-03-13 10:32:13,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,210 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:13,265 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057 src: /127.0.0.1:52854 dest: /127.0.0.1:52454
2015-03-13 10:32:13,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057 src: /127.0.0.1:52855 dest: /127.0.0.1:52447
2015-03-13 10:32:13,268 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057 src: /127.0.0.1:52856 dest: /127.0.0.1:52444
2015-03-13 10:32:13,280 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52856, dest: /127.0.0.1:52444, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 10661000
2015-03-13 10:32:13,280 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,280 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,280 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52855, dest: /127.0.0.1:52447, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 11161000
2015-03-13 10:32:13,281 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,281 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,282 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52854, dest: /127.0.0.1:52454, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 12336000
2015-03-13 10:32:13,283 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,283 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,286 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1
2015-03-13 10:32:13,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:13,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:13,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,317 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:13,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058 src: /127.0.0.1:52857 dest: /127.0.0.1:52444
2015-03-13 10:32:13,321 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058 src: /127.0.0.1:52858 dest: /127.0.0.1:52451
2015-03-13 10:32:13,323 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058 src: /127.0.0.1:52859 dest: /127.0.0.1:52454
2015-03-13 10:32:13,326 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52859, dest: /127.0.0.1:52454, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 1459000
2015-03-13 10:32:13,326 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,327 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,327 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52858, dest: /127.0.0.1:52451, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 2109000
2015-03-13 10:32:13,327 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,328 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,328 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52857, dest: /127.0.0.1:52444, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 3169000
2015-03-13 10:32:13,328 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,329 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,330 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1
2015-03-13 10:32:13,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0 dst=null perm=null
2015-03-13 10:32:13,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000 dst=null perm=null
2015-03-13 10:32:13,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:13,351 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0005_01_000003
2015-03-13 10:32:13,351 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:13,351 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:32:13,351 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0005_01_000003
2015-03-13 10:32:13,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:13,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,359 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1 dst=null perm=null
2015-03-13 10:32:13,363 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0005_01_000003 is : 143
2015-03-13 10:32:13,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:13,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:13,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000 dst=null perm=null
2015-03-13 10:32:13,372 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:13,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000 dst=null perm=null
2015-03-13 10:32:13,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:13,373 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0005_01_000003 from application application_1426267835672_0005
2015-03-13 10:32:13,373 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:13,373 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0005
2015-03-13 10:32:13,374 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary dst=null perm=null
2015-03-13 10:32:13,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,385 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,388 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,401 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52850, dest: /127.0.0.1:52444, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 5569115000
2015-03-13 10:32:13,401 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,402 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,402 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52849, dest: /127.0.0.1:52454, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 5569779000
2015-03-13 10:32:13,402 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,403 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,403 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52848, dest: /127.0.0.1:52447, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 5571274000
2015-03-13 10:32:13,403 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,404 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,405 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,409 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:13,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059 src: /127.0.0.1:52860 dest: /127.0.0.1:52444
2015-03-13 10:32:13,413 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059 src: /127.0.0.1:52861 dest: /127.0.0.1:52447
2015-03-13 10:32:13,414 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059 src: /127.0.0.1:52862 dest: /127.0.0.1:52451
2015-03-13 10:32:13,417 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52862, dest: /127.0.0.1:52451, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 1743000
2015-03-13 10:32:13,417 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,418 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,418 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52861, dest: /127.0.0.1:52447, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 2142000
2015-03-13 10:32:13,418 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,419 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,419 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52860, dest: /127.0.0.1:52444, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 3173000
2015-03-13 10:32:13,419 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,420 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,421 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist dst=null perm=null
2015-03-13 10:32:13,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:32:13,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist dst=null perm=null
2015-03-13 10:32:13,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:32:13,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist dst=null perm=null
2015-03-13 10:32:13,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,440 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52863, bytes: 37480, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 194000
2015-03-13 10:32:13,441 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:13,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060 src: /127.0.0.1:52864 dest: /127.0.0.1:52447
2015-03-13 10:32:13,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060 src: /127.0.0.1:52865 dest: /127.0.0.1:52444
2015-03-13 10:32:13,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060 src: /127.0.0.1:52866 dest: /127.0.0.1:52454
2015-03-13 10:32:13,448 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52866, dest: /127.0.0.1:52454, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, duration: 1755000
2015-03-13 10:32:13,448 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,449 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,449 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52865, dest: /127.0.0.1:52444, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, duration: 2288000
2015-03-13 10:32:13,449 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,449 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,449 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52864, dest: /127.0.0.1:52447, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, duration: 3160000
2015-03-13 10:32:13,450 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,450 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,451 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml dst=null perm=null
2015-03-13 10:32:13,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp dst=null perm=null
2015-03-13 10:32:13,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml dst=null perm=null
2015-03-13 10:32:13,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp dst=null perm=null
2015-03-13 10:32:13,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml dst=null perm=null
2015-03-13 10:32:13,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,466 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52867, bytes: 91390, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 355000
2015-03-13 10:32:13,468 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:13,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061 src: /127.0.0.1:52868 dest: /127.0.0.1:52444
2015-03-13 10:32:13,471 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061 src: /127.0.0.1:52869 dest: /127.0.0.1:52454
2015-03-13 10:32:13,472 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061 src: /127.0.0.1:52870 dest: /127.0.0.1:52451
2015-03-13 10:32:13,476 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52870, dest: /127.0.0.1:52451, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, duration: 2067000
2015-03-13 10:32:13,476 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,476 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,477 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52869, dest: /127.0.0.1:52454, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, duration: 2741000
2015-03-13 10:32:13,477 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,477 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,477 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52868, dest: /127.0.0.1:52444, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, duration: 3649000
2015-03-13 10:32:13,478 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,478 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,480 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,493 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from RUNNING to FINISHING
2015-03-13 10:32:13,493 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0005
2015-03-13 10:32:13,494 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from RUNNING to REMOVING
2015-03-13 10:32:13,494 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0005
2015-03-13 10:32:13,494 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from REMOVING to FINISHING
2015-03-13 10:32:13,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:14,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:14,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0005_01_000003
2015-03-13 10:32:14,353 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:14,353 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0005_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:32:14,353 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:14,353 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:14,353 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:14,353 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0005_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:14,353 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:14,354 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:14,354 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0005_000001 released container container_1426267835672_0005_01_000003 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:14,505 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741874_1050 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:32:14,505 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741875_1051 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52447
2015-03-13 10:32:14,506 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741876_1052 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:32:14,506 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741877_1053 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451
2015-03-13 10:32:14,506 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741880_1056 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:32:14,506 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741878_1054 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:32:14,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005 dst=null perm=null
2015-03-13 10:32:14,518 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:14,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,535 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary
2015-03-13 10:32:14,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary dst=null perm=null
2015-03-13 10:32:14,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,537 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary
2015-03-13 10:32:14,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary dst=null perm=null
2015-03-13 10:32:14,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary dst=null perm=null
2015-03-13 10:32:14,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,539 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary
2015-03-13 10:32:14,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary dst=null perm=null
2015-03-13 10:32:14,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,548 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:14,549 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:14,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,552 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:14,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000 dst=null perm=null
2015-03-13 10:32:14,555 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 185000
2015-03-13 10:32:14,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:14,563 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:14,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,567 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 2
2015-03-13 10:32:14,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:14,570 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52873, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 167000
2015-03-13 10:32:14,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:14,573 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52874, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 171000
2015-03-13 10:32:14,573 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/trapsourcesink/trap
2015-03-13 10:32:14,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap dst=null perm=null
2015-03-13 10:32:14,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:14,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:14,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52874, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 178000
2015-03-13 10:32:14,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:14,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:14,582 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52873, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 200000
2015-03-13 10:32:14,582 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/trapsourcesink/sink
2015-03-13 10:32:14,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink dst=null perm=null
2015-03-13 10:32:14,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000 dst=null perm=null
2015-03-13 10:32:14,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000 dst=null perm=null
2015-03-13 10:32:14,587 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 177000
2015-03-13 10:32:14,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:14,598 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,599 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:32:14,599 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:32:14,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:14,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:14,614 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:32:14,614 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:32:14,614 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap"]
2015-03-13 10:32:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:32:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:32:14,615 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:32:14,616 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...latform/everycomplete/tap
2015-03-13 10:32:14,629 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:14,641 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:14,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:14,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:14,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:14,646 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 6
2015-03-13 10:32:14,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006 dst=null perm=null
2015-03-13 10:32:14,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:32:14,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:32:14,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:14,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,653 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:14,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52876 dest: /127.0.0.1:52451
2015-03-13 10:32:14,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52877 dest: /127.0.0.1:52447
2015-03-13 10:32:14,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52878 dest: /127.0.0.1:52444
2015-03-13 10:32:14,660 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52878, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 1936000
2015-03-13 10:32:14,661 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,661 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52877, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 2789000
2015-03-13 10:32:14,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:14,661 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,662 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52876, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 3649000
2015-03-13 10:32:14,662 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,662 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:14,665 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:14,668 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,669 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar
2015-03-13 10:32:14,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:14,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:14,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:14,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:14,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:32:14,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:32:14,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:32:14,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:32:14,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:32:14,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:14,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:14,683 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:14,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:14,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,690 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split
2015-03-13 10:32:14,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:14,692 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:14,693 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52879 dest: /127.0.0.1:52444
2015-03-13 10:32:14,694 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52880 dest: /127.0.0.1:52447
2015-03-13 10:32:14,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52881 dest: /127.0.0.1:52451
2015-03-13 10:32:14,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52882 dest: /127.0.0.1:52454
2015-03-13 10:32:14,700 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52882, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 2629000
2015-03-13 10:32:14,700 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,700 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,700 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52881, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 3175000
2015-03-13 10:32:14,701 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,701 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,701 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52880, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 3930000
2015-03-13 10:32:14,701 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,702 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,702 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52879, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 4656000
2015-03-13 10:32:14,702 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,703 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,705 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,709 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:14,711 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064 src: /127.0.0.1:52883 dest: /127.0.0.1:52447
2015-03-13 10:32:14,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064 src: /127.0.0.1:52884 dest: /127.0.0.1:52444
2015-03-13 10:32:14,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064 src: /127.0.0.1:52885 dest: /127.0.0.1:52454
2015-03-13 10:32:14,717 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52885, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 1529000
2015-03-13 10:32:14,718 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,718 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,718 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52884, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 2034000
2015-03-13 10:32:14,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,719 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52883, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 3116000
2015-03-13 10:32:14,720 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,721 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,722 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,723 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:32:14,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,728 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:14,729 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:14,737 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:14,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065 src: /127.0.0.1:52886 dest: /127.0.0.1:52447
2015-03-13 10:32:14,740 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065 src: /127.0.0.1:52887 dest: /127.0.0.1:52444
2015-03-13 10:32:14,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065 src: /127.0.0.1:52888 dest: /127.0.0.1:52451
2015-03-13 10:32:14,744 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52888, dest: /127.0.0.1:52451, bytes: 98164, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 1304000
2015-03-13 10:32:14,745 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,745 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:14,745 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52887, dest: /127.0.0.1:52444, bytes: 98164, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 1858000
2015-03-13 10:32:14,745 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,746 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:14,746 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52886, dest: /127.0.0.1:52447, bytes: 98164, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 2735000
2015-03-13 10:32:14,746 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,747 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:14,749 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,749 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0006
2015-03-13 10:32:14,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006 dst=null perm=null
2015-03-13 10:32:14,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:14,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:14,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:14,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:14,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:14,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:14,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:14,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:14,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:14,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:14,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:14,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:14,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:14,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:14,765 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 6 submitted by user soberoi
2015-03-13 10:32:14,765 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0006
2015-03-13 10:32:14,766 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0006
2015-03-13 10:32:14,766 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0006
2015-03-13 10:32:14,766 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from NEW to NEW_SAVING
2015-03-13 10:32:14,766 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:32:14,766 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0006_000001
2015-03-13 10:32:14,767 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from NEW to SUBMITTED
2015-03-13 10:32:14,767 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0006 from user: soberoi activated in queue: default
2015-03-13 10:32:14,767 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0006 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:32:14,767 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0006 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:32:14,767 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0006_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:32:14,767 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0006 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:14,767 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:32:14,768 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from SUBMITTED to ACCEPTED
2015-03-13 10:32:14,770 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0006/
2015-03-13 10:32:14,771 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0006
2015-03-13 10:32:14,771 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0006/
2015-03-13 10:32:15,138 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:15,138 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:15,138 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:32:15,139 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0006_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:15,139 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:32:15,139 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:15,139 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:15,140 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0006 AttemptId: appattempt_1426267835672_0006_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:32:15,140 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:32:15,140 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0006_000001
2015-03-13 10:32:15,141 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:32:15,141 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0006_000001
2015-03-13 10:32:15,142 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0006_000001
2015-03-13 10:32:15,142 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0006_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:32:15,144 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:15,146 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000001 by user soberoi
2015-03-13 10:32:15,147 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0006
2015-03-13 10:32:15,147 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:15,147 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from NEW to INITING
2015-03-13 10:32:15,147 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000001 to application application_1426267835672_0006
2015-03-13 10:32:15,147 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0006_000001
2015-03-13 10:32:15,147 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from INITING to RUNNING
2015-03-13 10:32:15,147 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:32:15,148 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:32:15,148 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:15,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000001
2015-03-13 10:32:15,157 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0006_01_000001.tokens. Credentials list:
2015-03-13 10:32:15,172 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:15,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0006_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001.tokens
2015-03-13 10:32:15,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:15,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:15,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:15,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:15,316 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52892, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 489000
2015-03-13 10:32:15,335 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:15,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:15,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:15,357 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52873, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 160000
2015-03-13 10:32:15,367 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061
2015-03-13 10:32:15,367 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058
2015-03-13 10:32:15,367 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,368 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060
2015-03-13 10:32:15,368 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057
2015-03-13 10:32:15,369 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064
2015-03-13 10:32:15,369 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056
2015-03-13 10:32:15,370 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:15,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:15,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:15,393 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065
2015-03-13 10:32:15,393 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056
2015-03-13 10:32:15,394 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060
2015-03-13 10:32:15,394 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057
2015-03-13 10:32:15,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 170000
2015-03-13 10:32:15,405 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065
2015-03-13 10:32:15,405 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059
2015-03-13 10:32:15,406 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058
2015-03-13 10:32:15,406 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057
2015-03-13 10:32:15,406 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,407 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061
2015-03-13 10:32:15,407 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064
2015-03-13 10:32:15,408 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060
2015-03-13 10:32:15,408 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056
2015-03-13 10:32:15,411 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:15,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:15,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:15,434 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 98932, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 284000
2015-03-13 10:32:15,446 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,446 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:15,473 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:15,473 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:15,521 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:15,540 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001/default_container_executor.sh]
2015-03-13 10:32:15,594 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:15,594 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059
2015-03-13 10:32:15,595 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,595 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064
2015-03-13 10:32:15,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:15,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059
2015-03-13 10:32:15,808 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:15,837 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061
2015-03-13 10:32:15,838 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058
2015-03-13 10:32:15,839 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065
2015-03-13 10:32:15,839 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,927 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741886_1062 to datanode(s) 127.0.0.1:52454
2015-03-13 10:32:15,927 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741877_1053, blk_1073741878_1054, blk_1073741880_1056]
2015-03-13 10:32:15,928 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741880_1056]
2015-03-13 10:32:16,139 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:16,140 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:16,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876 for deletion
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877 for deletion
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878 for deletion
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880 for deletion
2015-03-13 10:32:16,605 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876
2015-03-13 10:32:16,606 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878
2015-03-13 10:32:16,606 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880
2015-03-13 10:32:16,606 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:16,606 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877
2015-03-13 10:32:16,612 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 to 127.0.0.1:52454
2015-03-13 10:32:16,613 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:16,613 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:16,613 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877 for deletion
2015-03-13 10:32:16,613 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878 for deletion
2015-03-13 10:32:16,613 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880 for deletion
2015-03-13 10:32:16,614 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878
2015-03-13 10:32:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877
2015-03-13 10:32:16,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880
2015-03-13 10:32:16,617 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:32:16,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52893 dest: /127.0.0.1:52454
2015-03-13 10:32:16,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52893 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:32:16,621 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741886_1062 size 254067
2015-03-13 10:32:17,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:17,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_STARTED dst=null perm=null
2015-03-13 10:32:17,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:32:17,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_FAIL dst=null perm=null
2015-03-13 10:32:17,142 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:17,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006 dst=null perm=null
2015-03-13 10:32:17,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:32:17,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:32:17,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:17,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:17,530 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:17,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52895, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 210000
2015-03-13 10:32:18,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:18,280 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:18,281 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0006_000001
2015-03-13 10:32:18,282 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0006 APPATTEMPTID=appattempt_1426267835672_0006_000001
2015-03-13 10:32:18,282 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:18,282 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from ACCEPTED to RUNNING
2015-03-13 10:32:18,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:18,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:18,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:18,497 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:18,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:18,536 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066 src: /127.0.0.1:52901 dest: /127.0.0.1:52444
2015-03-13 10:32:18,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066 src: /127.0.0.1:52902 dest: /127.0.0.1:52454
2015-03-13 10:32:18,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066 src: /127.0.0.1:52903 dest: /127.0.0.1:52451
2015-03-13 10:32:18,548 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52903, dest: /127.0.0.1:52451, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 6658000
2015-03-13 10:32:18,549 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:18,549 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52902, dest: /127.0.0.1:52454, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 7453000
2015-03-13 10:32:18,550 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:18,549 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:18,551 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52901, dest: /127.0.0.1:52444, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 9292000
2015-03-13 10:32:18,551 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:18,551 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:18,552 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:18,556 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:18,933 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741880_1056]
2015-03-13 10:32:18,933 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054]
2015-03-13 10:32:19,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:19,364 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,364 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:19,365 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:19,365 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,365 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:19,365 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,366 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,366 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:19,366 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:32:19,367 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,367 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:32:19,367 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,367 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,367 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:19,368 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:32:19,368 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,368 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:32:19,368 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,368 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,368 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:19,369 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:32:19,369 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,369 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:32:19,369 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:19,639 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0005_01_000001 succeeded
2015-03-13 10:32:19,640 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:19,640 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:32:19,648 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:19,648 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0005_01_000001 from application application_1426267835672_0005
2015-03-13 10:32:19,648 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:19,648 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0005
2015-03-13 10:32:19,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:19,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:19,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876 for deletion
2015-03-13 10:32:19,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877 for deletion
2015-03-13 10:32:19,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:19,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:19,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878 for deletion
2015-03-13 10:32:19,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877
2015-03-13 10:32:19,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876
2015-03-13 10:32:19,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878
2015-03-13 10:32:19,975 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:19,975 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:19,976 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876 for deletion
2015-03-13 10:32:19,976 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:19,976 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880 for deletion
2015-03-13 10:32:19,976 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876
2015-03-13 10:32:19,976 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:19,977 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880
2015-03-13 10:32:20,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:20,315 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,315 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,315 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,316 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:20,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:20,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:20,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:20,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:20,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:20,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:20,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:20,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:20,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:20,380 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:20,440 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:20,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000002 by user soberoi
2015-03-13 10:32:20,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000004 by user soberoi
2015-03-13 10:32:20,442 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0006
2015-03-13 10:32:20,443 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000003 by user soberoi
2015-03-13 10:32:20,443 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000004 to application application_1426267835672_0006
2015-03-13 10:32:20,443 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:20,443 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:20,443 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from NEW to INITING
2015-03-13 10:32:20,443 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000002 to application application_1426267835672_0006
2015-03-13 10:32:20,443 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000005 by user soberoi
2015-03-13 10:32:20,444 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:20,443 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:20,443 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000003 to application application_1426267835672_0006
2015-03-13 10:32:20,444 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000005 to application application_1426267835672_0006
2015-03-13 10:32:20,444 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from INITING to RUNNING
2015-03-13 10:32:20,445 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,446 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,446 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:20,446 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:20,446 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,446 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,447 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,447 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,447 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,447 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,448 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000004
2015-03-13 10:32:20,448 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000005
2015-03-13 10:32:20,449 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000003
2015-03-13 10:32:20,449 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000002
2015-03-13 10:32:20,468 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000002.tokens. Credentials list:
2015-03-13 10:32:20,469 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0006_01_000005.tokens. Credentials list:
2015-03-13 10:32:20,469 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0006_01_000004.tokens. Credentials list:
2015-03-13 10:32:20,469 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000003.tokens. Credentials list:
2015-03-13 10:32:20,484 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:20,539 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:20,539 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0005_01_000001
2015-03-13 10:32:20,540 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:20,540 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0005_000001
2015-03-13 10:32:20,540 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0005_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:20,540 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:20,540 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0005 CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:32:20,540 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from FINISHING to FINISHED
2015-03-13 10:32:20,540 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:20,541 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0005
2015-03-13 10:32:20,541 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0005_000001
2015-03-13 10:32:20,541 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0005,name=[AA7C1D7EA74C4401BE2D2CFBE5BCEEF1/5E7BEE4954DF42539615E4FD31314DC4] trap test/(1/1) ...tform/trapsourcesink/sink,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0005/jobhistory/job/job_1426267835672_0005,appMasterHost=Edinburgh.local,startTime=1426267919207,finishTime=1426267933494,finalStatus=SUCCEEDED
2015-03-13 10:32:20,541 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:32:20,541 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:20,541 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:20,541 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:32:20,541 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0005_000001 released container container_1426267835672_0005_01_000001 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:20,541 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0005_000001 is done. finalState=FINISHED
2015-03-13 10:32:20,542 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0005 requests cleared
2015-03-13 10:32:20,542 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0005 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:20,542 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0005 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:20,543 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:32:20,545 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0005_01_000001
2015-03-13 10:32:20,555 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002.tokens
2015-03-13 10:32:20,555 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:20,579 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066
2015-03-13 10:32:20,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:20,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:20,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:20,624 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52908, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-310803793_3133, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 506000
2015-03-13 10:32:20,642 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:20,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:20,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:20,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:20,664 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52908, bytes: 98932, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-310803793_3133, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 239000
2015-03-13 10:32:20,677 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:20,677 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,677 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,677 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,678 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,725 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,725 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,725 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,725 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,726 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,726 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,739 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,739 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,815 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066
2015-03-13 10:32:20,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005/default_container_executor.sh]
2015-03-13 10:32:20,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002/default_container_executor.sh]
2015-03-13 10:32:20,831 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003/default_container_executor.sh]
2015-03-13 10:32:20,843 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066
2015-03-13 10:32:20,865 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004/default_container_executor.sh]
2015-03-13 10:32:21,158 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,328 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:32:21,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:21,373 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0005
2015-03-13 10:32:21,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:21,373 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0005, with delay of 10800 seconds
2015-03-13 10:32:21,374 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,374 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,541 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:21,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,542 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0005
2015-03-13 10:32:21,542 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:21,542 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0005, with delay of 10800 seconds
2015-03-13 10:32:21,542 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,709 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:21,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003.tokens
2015-03-13 10:32:21,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:21,929 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:22,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0006_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004.tokens
2015-03-13 10:32:22,075 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:22,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:22,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0006_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005.tokens
2015-03-13 10:32:22,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:22,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,374 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,377 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,379 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,379 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,168 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,380 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,173 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,384 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,384 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,384 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:27,174 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:27,220 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52917, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000003_0_2129760938_1, offset: 1024, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 184000
2015-03-13 10:32:27,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:27,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split dst=null perm=null
2015-03-13 10:32:27,379 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52919, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000000_0_-1479098652_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 174000
2015-03-13 10:32:27,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:27,388 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52922, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000003_0_2129760938_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 184000
2015-03-13 10:32:27,388 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:27,496 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52925, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000000_0_-1479098652_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 164000
2015-03-13 10:32:27,500 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52923, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000002_0_126898450_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 179000
2015-03-13 10:32:27,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52924, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000001_0_-409086295_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 167000
2015-03-13 10:32:27,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:27,593 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52926, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000002_0_126898450_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1061000
2015-03-13 10:32:27,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:27,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000003_0 dst=null perm=null
2015-03-13 10:32:27,776 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000005
2015-03-13 10:32:27,776 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:27,776 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:32:27,776 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000005
2015-03-13 10:32:27,776 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,777 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,777 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,777 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:27,789 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000005 is : 143
2015-03-13 10:32:27,792 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:27,793 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067 src: /127.0.0.1:52927 dest: /127.0.0.1:52444
2015-03-13 10:32:27,795 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067 src: /127.0.0.1:52928 dest: /127.0.0.1:52447
2015-03-13 10:32:27,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067 src: /127.0.0.1:52929 dest: /127.0.0.1:52454
2015-03-13 10:32:27,803 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist for DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:27,805 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:27,806 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:27,807 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000005 from application application_1426267835672_0006
2015-03-13 10:32:27,807 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:27,807 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:27,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000000_0 dst=null perm=null
2015-03-13 10:32:27,913 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000002
2015-03-13 10:32:27,914 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:27,914 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:32:27,914 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000002
2015-03-13 10:32:27,914 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:27,915 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,915 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,915 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:27,915 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000005
2015-03-13 10:32:27,916 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:27,916 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:32:27,916 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:27,916 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:32:27,916 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:32:27,916 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:27,917 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:27,917 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:32:27,917 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000005 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:32:27,927 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000002 is : 143
2015-03-13 10:32:27,940 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:27,940 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,940 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:27,941 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000002 from application application_1426267835672_0006
2015-03-13 10:32:27,941 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:27,942 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:27,978 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52930, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000001_0_-409086295_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1336000
2015-03-13 10:32:28,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000001_0 dst=null perm=null
2015-03-13 10:32:28,020 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000003
2015-03-13 10:32:28,020 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:28,021 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:32:28,021 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000003
2015-03-13 10:32:28,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:28,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000002
2015-03-13 10:32:28,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:28,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:28,022 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:28,022 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:32:28,022 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:28,022 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:32:28,023 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:32:28,023 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,023 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,023 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:32:28,023 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000002 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:32:28,034 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000003 is : 143
2015-03-13 10:32:28,046 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:28,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:28,048 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:28,048 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000003 from application application_1426267835672_0006
2015-03-13 10:32:28,048 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:28,048 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:28,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000002_0 dst=null perm=null
2015-03-13 10:32:28,069 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000004
2015-03-13 10:32:28,069 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:28,069 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:32:28,070 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000004
2015-03-13 10:32:28,070 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:28,070 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000003
2015-03-13 10:32:28,070 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:28,071 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:28,071 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:32:28,071 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:28,071 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:32:28,071 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:32:28,071 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,072 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,072 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:28,072 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000003 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:32:28,081 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000004 is : 143
2015-03-13 10:32:28,089 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:28,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:28,090 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000004 from application application_1426267835672_0006
2015-03-13 10:32:28,091 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:28,091 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:28,176 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:29,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:29,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000004
2015-03-13 10:32:29,072 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:29,072 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:32:29,072 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:29,073 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:29,073 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:29,073 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:29,073 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:29,073 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:29,073 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000004 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:29,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:29,553 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:29,553 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:29,554 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:29,554 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000006, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0006_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:29,554 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:29,554 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:30,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:30,365 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:30,376 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:30,378 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000006 by user soberoi
2015-03-13 10:32:30,378 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0006
2015-03-13 10:32:30,379 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:30,379 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from NEW to INITING
2015-03-13 10:32:30,379 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000006 to application application_1426267835672_0006
2015-03-13 10:32:30,380 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from INITING to RUNNING
2015-03-13 10:32:30,380 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:32:30,380 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:30,381 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:30,381 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:30,381 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:30,381 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:30,381 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:30,381 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000006
2015-03-13 10:32:30,390 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0006_01_000006.tokens. Credentials list:
2015-03-13 10:32:30,406 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:30,476 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006.tokens
2015-03-13 10:32:30,476 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:30,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:30,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:30,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar dst=null perm=null
2015-03-13 10:32:30,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52934, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_899693614_3400, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 507000
2015-03-13 10:32:30,553 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:30,553 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:30,566 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:30,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:30,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:30,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml dst=null perm=null
2015-03-13 10:32:30,589 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52935, bytes: 98932, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_899693614_3400, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 301000
2015-03-13 10:32:30,602 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:30,603 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:30,632 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:30,633 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:30,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006/default_container_executor.sh]
2015-03-13 10:32:31,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:31,374 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:32:31,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:32,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:32,559 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:33,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary dst=null perm=null
2015-03-13 10:32:33,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:33,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,151 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:33,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:33,206 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068 src: /127.0.0.1:52940 dest: /127.0.0.1:52444
2015-03-13 10:32:33,207 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068 src: /127.0.0.1:52941 dest: /127.0.0.1:52454
2015-03-13 10:32:33,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068 src: /127.0.0.1:52942 dest: /127.0.0.1:52451
2015-03-13 10:32:33,219 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52942, dest: /127.0.0.1:52451, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 9749000
2015-03-13 10:32:33,219 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,220 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52941, dest: /127.0.0.1:52454, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 10342000
2015-03-13 10:32:33,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,220 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,221 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52940, dest: /127.0.0.1:52444, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 11365000
2015-03-13 10:32:33,221 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,224 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1
2015-03-13 10:32:33,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:33,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:33,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,251 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1
2015-03-13 10:32:33,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0 dst=null perm=null
2015-03-13 10:32:33,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000 dst=null perm=null
2015-03-13 10:32:33,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:33,269 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000006
2015-03-13 10:32:33,270 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:33,270 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:32:33,270 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000006
2015-03-13 10:32:33,270 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:33,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,278 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,280 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000006 is : 143
2015-03-13 10:32:33,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1 dst=null perm=null
2015-03-13 10:32:33,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:33,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:33,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000 dst=null perm=null
2015-03-13 10:32:33,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000 dst=null perm=null
2015-03-13 10:32:33,290 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:33,291 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:33,292 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000006 from application application_1426267835672_0006
2015-03-13 10:32:33,292 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:33,292 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:33,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary dst=null perm=null
2015-03-13 10:32:33,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,302 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,306 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,320 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52929, dest: /127.0.0.1:52454, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 5521416000
2015-03-13 10:32:33,320 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,321 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,321 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52928, dest: /127.0.0.1:52447, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 5521649000
2015-03-13 10:32:33,322 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,323 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,323 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52927, dest: /127.0.0.1:52444, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 5524702000
2015-03-13 10:32:33,323 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,324 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,325 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,328 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:33,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069 src: /127.0.0.1:52943 dest: /127.0.0.1:52451
2015-03-13 10:32:33,332 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069 src: /127.0.0.1:52944 dest: /127.0.0.1:52444
2015-03-13 10:32:33,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069 src: /127.0.0.1:52945 dest: /127.0.0.1:52447
2015-03-13 10:32:33,336 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52945, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 1195000
2015-03-13 10:32:33,336 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,336 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:33,336 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52944, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 1795000
2015-03-13 10:32:33,337 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,337 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:33,337 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52943, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 2845000
2015-03-13 10:32:33,338 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,338 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:33,339 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist dst=null perm=null
2015-03-13 10:32:33,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:32:33,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist dst=null perm=null
2015-03-13 10:32:33,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:32:33,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist dst=null perm=null
2015-03-13 10:32:33,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52946, bytes: 60209, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 240000
2015-03-13 10:32:33,357 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:33,359 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070 src: /127.0.0.1:52947 dest: /127.0.0.1:52451
2015-03-13 10:32:33,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070 src: /127.0.0.1:52948 dest: /127.0.0.1:52444
2015-03-13 10:32:33,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070 src: /127.0.0.1:52949 dest: /127.0.0.1:52454
2015-03-13 10:32:33,365 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52949, dest: /127.0.0.1:52454, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, duration: 1893000
2015-03-13 10:32:33,365 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,366 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52948, dest: /127.0.0.1:52444, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, duration: 2697000
2015-03-13 10:32:33,366 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,367 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,367 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52947, dest: /127.0.0.1:52451, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, duration: 3548000
2015-03-13 10:32:33,367 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,368 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,369 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml dst=null perm=null
2015-03-13 10:32:33,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp dst=null perm=null
2015-03-13 10:32:33,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml dst=null perm=null
2015-03-13 10:32:33,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp dst=null perm=null
2015-03-13 10:32:33,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml dst=null perm=null
2015-03-13 10:32:33,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,382 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52946, bytes: 91464, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 331000
2015-03-13 10:32:33,384 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:33,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071 src: /127.0.0.1:52950 dest: /127.0.0.1:52444
2015-03-13 10:32:33,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071 src: /127.0.0.1:52951 dest: /127.0.0.1:52454
2015-03-13 10:32:33,388 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071 src: /127.0.0.1:52952 dest: /127.0.0.1:52451
2015-03-13 10:32:33,391 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52952, dest: /127.0.0.1:52451, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, duration: 1987000
2015-03-13 10:32:33,391 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,392 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,392 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52951, dest: /127.0.0.1:52454, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, duration: 2561000
2015-03-13 10:32:33,392 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,393 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,393 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52950, dest: /127.0.0.1:52444, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, duration: 3448000
2015-03-13 10:32:33,393 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,394 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,395 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,406 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from RUNNING to FINISHING
2015-03-13 10:32:33,407 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0006
2015-03-13 10:32:33,407 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from RUNNING to REMOVING
2015-03-13 10:32:33,407 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0006
2015-03-13 10:32:33,407 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from REMOVING to FINISHING
2015-03-13 10:32:34,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:34,271 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:34,271 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000006
2015-03-13 10:32:34,272 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:34,272 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:32:34,272 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:34,273 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:34,273 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:34,273 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000006, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:34,273 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:34,273 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:34,273 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000006 on node: host: 10.1.1.144:52469 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:34,416 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741886_1062 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:32:34,416 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52454
2015-03-13 10:32:34,416 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:32:34,417 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451
2015-03-13 10:32:34,417 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:32:34,417 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:32:34,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006 dst=null perm=null
2015-03-13 10:32:34,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,446 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary
2015-03-13 10:32:34,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary dst=null perm=null
2015-03-13 10:32:34,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,447 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary
2015-03-13 10:32:34,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary dst=null perm=null
2015-03-13 10:32:34,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary dst=null perm=null
2015-03-13 10:32:34,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:34,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:34,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,460 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:34,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000 dst=null perm=null
2015-03-13 10:32:34,468 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,468 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:34,469 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:34,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,472 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:34,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:34,475 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52954, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 194000
2015-03-13 10:32:34,475 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everycomplete/trap
2015-03-13 10:32:34,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap dst=null perm=null
2015-03-13 10:32:34,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:34,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:32:34,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52955, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 174000
2015-03-13 10:32:34,482 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everycomplete/tap
2015-03-13 10:32:34,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap dst=null perm=null
2015-03-13 10:32:34,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000 dst=null perm=null
2015-03-13 10:32:34,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000 dst=null perm=null
2015-03-13 10:32:34,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:34,499 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,500 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:32:34,500 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:32:34,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:34,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:34,515 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:32:34,515 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:32:34,515 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic"]
2015-03-13 10:32:34,516 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:32:34,516 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:32:34,516 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:32:34,516 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...hain/tap-nondeterministic
2015-03-13 10:32:34,525 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:34,534 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:34,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:34,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:34,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:34,539 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 7
2015-03-13 10:32:34,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007 dst=null perm=null
2015-03-13 10:32:34,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:32:34,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:32:34,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:34,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,546 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:34,547 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52957 dest: /127.0.0.1:52444
2015-03-13 10:32:34,548 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52958 dest: /127.0.0.1:52451
2015-03-13 10:32:34,549 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52959 dest: /127.0.0.1:52454
2015-03-13 10:32:34,553 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52959, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 1971000
2015-03-13 10:32:34,553 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,554 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:34,554 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52958, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 2539000
2015-03-13 10:32:34,554 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,554 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:34,555 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52957, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 3732000
2015-03-13 10:32:34,555 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,556 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:34,557 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,558 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar
2015-03-13 10:32:34,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:34,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:34,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:34,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:34,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:32:34,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:32:34,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:32:34,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:32:34,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:32:34,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:34,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:34,570 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:34,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:34,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,575 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split
2015-03-13 10:32:34,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:34,576 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:34,578 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52960 dest: /127.0.0.1:52444
2015-03-13 10:32:34,579 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52961 dest: /127.0.0.1:52454
2015-03-13 10:32:34,581 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52962 dest: /127.0.0.1:52451
2015-03-13 10:32:34,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52963 dest: /127.0.0.1:52447
2015-03-13 10:32:34,585 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52963, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 1525000
2015-03-13 10:32:34,585 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,585 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,585 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52962, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 1895000
2015-03-13 10:32:34,586 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,586 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,586 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52961, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 2656000
2015-03-13 10:32:34,586 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,587 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,587 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52960, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 3408000
2015-03-13 10:32:34,587 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,589 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,590 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,593 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:34,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074 src: /127.0.0.1:52964 dest: /127.0.0.1:52447
2015-03-13 10:32:34,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074 src: /127.0.0.1:52965 dest: /127.0.0.1:52444
2015-03-13 10:32:34,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074 src: /127.0.0.1:52966 dest: /127.0.0.1:52451
2015-03-13 10:32:34,599 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52966, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 1150000
2015-03-13 10:32:34,599 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,599 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,600 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52965, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 1547000
2015-03-13 10:32:34,600 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,600 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,600 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52964, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 2298000
2015-03-13 10:32:34,601 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,603 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,604 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,604 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:32:34,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,608 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:34,609 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:34,615 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:34,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075 src: /127.0.0.1:52967 dest: /127.0.0.1:52454
2015-03-13 10:32:34,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075 src: /127.0.0.1:52968 dest: /127.0.0.1:52447
2015-03-13 10:32:34,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075 src: /127.0.0.1:52969 dest: /127.0.0.1:52451
2015-03-13 10:32:34,622 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52969, dest: /127.0.0.1:52451, bytes: 97209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 1455000
2015-03-13 10:32:34,622 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,623 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,623 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52968, dest: /127.0.0.1:52447, bytes: 97209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 2104000
2015-03-13 10:32:34,623 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,624 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52967, dest: /127.0.0.1:52454, bytes: 97209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 3006000
2015-03-13 10:32:34,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,626 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,627 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0007
2015-03-13 10:32:34,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007 dst=null perm=null
2015-03-13 10:32:34,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:34,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:34,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:34,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:34,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:34,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:34,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:34,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:34,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:34,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:34,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:34,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:34,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:34,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:34,642 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 7 submitted by user soberoi
2015-03-13 10:32:34,642 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0007
2015-03-13 10:32:34,642 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0007
2015-03-13 10:32:34,642 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0007
2015-03-13 10:32:34,642 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from NEW to NEW_SAVING
2015-03-13 10:32:34,642 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:32:34,643 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0007_000001
2015-03-13 10:32:34,643 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from NEW to SUBMITTED
2015-03-13 10:32:34,643 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0007 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:34,643 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0007 from user: soberoi activated in queue: default
2015-03-13 10:32:34,643 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0007 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:32:34,643 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0007 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:32:34,643 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0007_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:32:34,644 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:32:34,644 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from SUBMITTED to ACCEPTED
2015-03-13 10:32:34,645 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0007/
2015-03-13 10:32:34,645 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0007
2015-03-13 10:32:34,645 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0007/
2015-03-13 10:32:35,089 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:35,089 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:35,089 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:32:35,090 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0007_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:35,090 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:32:35,090 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:35,090 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:35,091 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0007 AttemptId: appattempt_1426267835672_0007_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:32:35,091 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:32:35,091 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0007_000001
2015-03-13 10:32:35,092 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:32:35,092 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0007_000001
2015-03-13 10:32:35,092 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0007_000001
2015-03-13 10:32:35,093 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:32:35,095 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:35,097 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000001 by user soberoi
2015-03-13 10:32:35,097 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0007
2015-03-13 10:32:35,097 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:35,097 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from NEW to INITING
2015-03-13 10:32:35,097 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000001 to application application_1426267835672_0007
2015-03-13 10:32:35,098 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from INITING to RUNNING
2015-03-13 10:32:35,098 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0007_000001
2015-03-13 10:32:35,098 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:32:35,098 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:35,098 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:32:35,098 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000001
2015-03-13 10:32:35,108 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0007_01_000001.tokens. Credentials list:
2015-03-13 10:32:35,123 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:35,193 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001.tokens
2015-03-13 10:32:35,193 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:35,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:35,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:35,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:35,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:35,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52955, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 508000
2015-03-13 10:32:35,281 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:35,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:35,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:35,304 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52973, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 174000
2015-03-13 10:32:35,316 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:35,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:35,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:35,339 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52954, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 173000
2015-03-13 10:32:35,351 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:35,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:35,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:35,374 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52955, bytes: 97969, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 269000
2015-03-13 10:32:35,386 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,386 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:35,411 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:35,411 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:35,477 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001/default_container_executor.sh]
2015-03-13 10:32:35,584 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071
2015-03-13 10:32:35,585 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068
2015-03-13 10:32:35,585 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070
2015-03-13 10:32:35,586 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067
2015-03-13 10:32:35,605 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:35,606 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067
2015-03-13 10:32:35,606 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074
2015-03-13 10:32:35,606 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069
2015-03-13 10:32:35,607 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075
2015-03-13 10:32:35,791 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:35,792 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075
2015-03-13 10:32:35,792 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:35,826 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070
2015-03-13 10:32:35,826 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:35,852 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071
2015-03-13 10:32:35,853 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075
2015-03-13 10:32:36,032 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:36,032 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069
2015-03-13 10:32:36,033 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068
2015-03-13 10:32:36,033 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074
2015-03-13 10:32:36,034 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067
2015-03-13 10:32:36,034 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071
2015-03-13 10:32:36,054 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:36,054 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069
2015-03-13 10:32:36,054 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074
2015-03-13 10:32:36,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070
2015-03-13 10:32:36,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:36,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068
2015-03-13 10:32:36,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:36,092 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:36,205 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:36,953 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52454 to replicate blk_1073741896_1072 to datanode(s) 127.0.0.1:52447
2015-03-13 10:32:36,953 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:36,953 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741891_1067, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:37,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:37,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:37,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_STARTED dst=null perm=null
2015-03-13 10:32:37,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:32:37,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_FAIL dst=null perm=null
2015-03-13 10:32:37,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007 dst=null perm=null
2015-03-13 10:32:37,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:32:37,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:32:37,209 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:37,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:37,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:37,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52975, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 192000
2015-03-13 10:32:37,618 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888 for deletion
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889 for deletion
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891 for deletion
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:37,619 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891
2015-03-13 10:32:37,620 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:37,987 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 to 127.0.0.1:52447
2015-03-13 10:32:37,987 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888 for deletion
2015-03-13 10:32:37,987 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890 for deletion
2015-03-13 10:32:37,987 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891 for deletion
2015-03-13 10:32:37,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:37,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:37,989 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:32:37,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891
2015-03-13 10:32:37,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:37,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888
2015-03-13 10:32:37,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:37,990 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890
2015-03-13 10:32:37,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52978 dest: /127.0.0.1:52447
2015-03-13 10:32:37,991 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52978 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:32:37,992 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741896_1072 size 254067
2015-03-13 10:32:38,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:38,211 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:38,235 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:38,236 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0007_000001
2015-03-13 10:32:38,237 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0007 APPATTEMPTID=appattempt_1426267835672_0007_000001
2015-03-13 10:32:38,237 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:38,237 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from ACCEPTED to RUNNING
2015-03-13 10:32:38,257 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 656 Total time for transactions(ms): 51 Number of transactions batched in Syncs: 11 Number of syncs: 363 SyncTimes(ms): 91 58
2015-03-13 10:32:38,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:38,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:38,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:38,465 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:38,504 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076 src: /127.0.0.1:52982 dest: /127.0.0.1:52451
2015-03-13 10:32:38,506 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076 src: /127.0.0.1:52983 dest: /127.0.0.1:52447
2015-03-13 10:32:38,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076 src: /127.0.0.1:52984 dest: /127.0.0.1:52454
2015-03-13 10:32:38,517 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52984, dest: /127.0.0.1:52454, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 6383000
2015-03-13 10:32:38,518 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:38,518 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:38,518 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52983, dest: /127.0.0.1:52447, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 7096000
2015-03-13 10:32:38,519 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:38,519 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:38,519 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52982, dest: /127.0.0.1:52451, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 7933000
2015-03-13 10:32:38,519 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:38,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:38,524 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:39,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:39,211 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:39,276 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,277 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:39,277 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:39,277 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000002, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,277 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:39,278 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,278 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,279 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:39,279 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:32:39,279 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,279 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:32:39,279 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,280 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,280 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:39,280 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:32:39,280 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000004, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,280 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:32:39,280 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,281 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,281 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:39,281 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:32:39,281 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000005, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,281 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:32:39,281 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,551 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0006_01_000001 succeeded
2015-03-13 10:32:39,552 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:39,552 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:39,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000001 from application application_1426267835672_0006
2015-03-13 10:32:39,562 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:39,562 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:39,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,959 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:39,959 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:40,104 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:40,212 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:40,213 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000001
2015-03-13 10:32:40,213 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:40,213 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0006_000001
2015-03-13 10:32:40,213 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:40,214 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:40,214 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0006 CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:40,214 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from FINISHING to FINISHED
2015-03-13 10:32:40,214 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:40,214 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0006
2015-03-13 10:32:40,214 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:32:40,215 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0006,name=[2E6720DC81AE485EA9AF60ED96CF5170/FD9C0A1F88154A1F92C3C9299F12FC78] trap test/(1/1) ...latform/everycomplete/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0006/jobhistory/job/job_1426267835672_0006,appMasterHost=Edinburgh.local,startTime=1426267934765,finishTime=1426267953407,finalStatus=SUCCEEDED
2015-03-13 10:32:40,214 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0006_000001
2015-03-13 10:32:40,215 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:40,215 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:40,215 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:32:40,215 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000001 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:40,216 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0006_000001 is done. finalState=FINISHED
2015-03-13 10:32:40,216 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0006 requests cleared
2015-03-13 10:32:40,216 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0006 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:40,216 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0006 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:40,218 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:40,220 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000001
2015-03-13 10:32:40,270 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,270 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,271 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,271 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,278 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:40,279 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,279 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0006
2015-03-13 10:32:40,279 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:40,279 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0006, with delay of 10800 seconds
2015-03-13 10:32:40,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:40,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:40,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:40,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:40,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:40,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:40,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:40,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:40,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:40,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:40,392 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:40,395 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000005 by user soberoi
2015-03-13 10:32:40,395 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000002 by user soberoi
2015-03-13 10:32:40,395 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0007
2015-03-13 10:32:40,396 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:40,395 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000004 by user soberoi
2015-03-13 10:32:40,395 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000003 by user soberoi
2015-03-13 10:32:40,396 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:40,396 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000002 to application application_1426267835672_0007
2015-03-13 10:32:40,396 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:40,396 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from NEW to INITING
2015-03-13 10:32:40,397 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000005 to application application_1426267835672_0007
2015-03-13 10:32:40,396 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:40,397 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000004 to application application_1426267835672_0007
2015-03-13 10:32:40,397 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000003 to application application_1426267835672_0007
2015-03-13 10:32:40,397 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from INITING to RUNNING
2015-03-13 10:32:40,397 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,398 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,398 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,398 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,399 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:40,399 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:40,399 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,399 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,399 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,399 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,400 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,400 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,400 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,400 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,401 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000003
2015-03-13 10:32:40,402 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000004
2015-03-13 10:32:40,402 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000005
2015-03-13 10:32:40,403 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000002
2015-03-13 10:32:40,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0007_01_000004.tokens. Credentials list:
2015-03-13 10:32:40,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0007_01_000002.tokens. Credentials list:
2015-03-13 10:32:40,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426267835672_0007_01_000003.tokens. Credentials list:
2015-03-13 10:32:40,421 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426267835672_0007_01_000005.tokens. Credentials list:
2015-03-13 10:32:40,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:40,504 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0007_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004.tokens
2015-03-13 10:32:40,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:40,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:40,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:40,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar dst=null perm=null
2015-03-13 10:32:40,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52990, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_252700680_3661, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 604000
2015-03-13 10:32:40,598 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:40,612 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:40,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:40,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:40,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml dst=null perm=null
2015-03-13 10:32:40,620 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888 for deletion
2015-03-13 10:32:40,620 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889 for deletion
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890 for deletion
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891 for deletion
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:40,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889
2015-03-13 10:32:40,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891
2015-03-13 10:32:40,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:40,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:40,627 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52991, bytes: 97969, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_252700680_3661, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 298000
2015-03-13 10:32:40,642 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:40,642 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,642 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,642 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,642 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,694 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,694 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,696 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,696 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,696 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,697 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,697 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,697 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,796 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076
2015-03-13 10:32:40,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005/default_container_executor.sh]
2015-03-13 10:32:40,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002/default_container_executor.sh]
2015-03-13 10:32:40,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004/default_container_executor.sh]
2015-03-13 10:32:40,814 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076
2015-03-13 10:32:40,819 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003/default_container_executor.sh]
2015-03-13 10:32:40,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889 for deletion
2015-03-13 10:32:40,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890 for deletion
2015-03-13 10:32:40,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:40,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:40,843 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889
2015-03-13 10:32:40,844 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:40,844 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890
2015-03-13 10:32:40,844 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:41,061 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076
2015-03-13 10:32:41,109 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,110 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:41,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0006
2015-03-13 10:32:41,111 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:41,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0006, with delay of 10800 seconds
2015-03-13 10:32:41,213 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:41,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,214 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0006
2015-03-13 10:32:41,215 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:41,215 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0006, with delay of 10800 seconds
2015-03-13 10:32:41,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,282 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,282 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,282 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,283 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,283 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,283 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,284 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,284 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,284 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:32:41,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:41,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426267835672_0007_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005.tokens
2015-03-13 10:32:41,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:41,896 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:42,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426267835672_0007_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003.tokens
2015-03-13 10:32:42,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:42,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:42,110 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,235 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0007_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002.tokens
2015-03-13 10:32:42,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:42,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,113 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,288 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,115 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,294 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,294 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,294 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,301 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,125 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:47,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:47,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:47,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split dst=null perm=null
2015-03-13 10:32:47,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,311 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53002, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 201000
2015-03-13 10:32:47,403 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53005, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 162000
2015-03-13 10:32:47,405 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53004, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 170000
2015-03-13 10:32:47,436 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53006, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 512, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 168000
2015-03-13 10:32:47,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:47,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:47,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:47,497 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53004, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 156000
2015-03-13 10:32:47,501 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53007, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 158000
2015-03-13 10:32:47,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:47,533 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53008, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 178000
2015-03-13 10:32:47,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,753 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53009, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 167000
2015-03-13 10:32:47,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:47,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:47,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,806 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:47,815 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:47,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077 src: /127.0.0.1:53010 dest: /127.0.0.1:52447
2015-03-13 10:32:47,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077 src: /127.0.0.1:53012 dest: /127.0.0.1:52444
2015-03-13 10:32:47,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077 src: /127.0.0.1:53013 dest: /127.0.0.1:52451
2015-03-13 10:32:47,859 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078 src: /127.0.0.1:53011 dest: /127.0.0.1:52447
2015-03-13 10:32:47,861 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078 src: /127.0.0.1:53014 dest: /127.0.0.1:52451
2015-03-13 10:32:47,862 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078 src: /127.0.0.1:53015 dest: /127.0.0.1:52454
2015-03-13 10:32:47,863 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53013, dest: /127.0.0.1:52451, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 10859000
2015-03-13 10:32:47,863 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,863 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:47,864 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53012, dest: /127.0.0.1:52444, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 11497000
2015-03-13 10:32:47,866 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,866 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:47,867 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53010, dest: /127.0.0.1:52447, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 14983000
2015-03-13 10:32:47,867 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:47,873 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1
2015-03-13 10:32:47,874 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53015, dest: /127.0.0.1:52454, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 10146000
2015-03-13 10:32:47,874 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,875 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,875 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53014, dest: /127.0.0.1:52451, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 9974000
2015-03-13 10:32:47,875 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,875 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,876 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53011, dest: /127.0.0.1:52447, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 10226000
2015-03-13 10:32:47,876 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,876 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,881 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1
2015-03-13 10:32:47,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001 dst=null perm=null
2015-03-13 10:32:47,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:47,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,918 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0/part-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:47,920 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079 src: /127.0.0.1:53016 dest: /127.0.0.1:52451
2015-03-13 10:32:47,922 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079 src: /127.0.0.1:53017 dest: /127.0.0.1:52447
2015-03-13 10:32:47,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079 src: /127.0.0.1:53018 dest: /127.0.0.1:52454
2015-03-13 10:32:47,926 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53018, dest: /127.0.0.1:52454, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 1638000
2015-03-13 10:32:47,926 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,927 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,927 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53017, dest: /127.0.0.1:52447, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 2293000
2015-03-13 10:32:47,927 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,927 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,928 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53016, dest: /127.0.0.1:52451, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 3060000
2015-03-13 10:32:47,928 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,928 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,931 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0/part-00001 is closed by DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1
2015-03-13 10:32:47,933 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:47,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080 src: /127.0.0.1:53019 dest: /127.0.0.1:52444
2015-03-13 10:32:47,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080 src: /127.0.0.1:53020 dest: /127.0.0.1:52451
2015-03-13 10:32:47,938 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080 src: /127.0.0.1:53021 dest: /127.0.0.1:52447
2015-03-13 10:32:47,941 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53021, dest: /127.0.0.1:52447, bytes: 23, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 1361000
2015-03-13 10:32:47,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,941 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,942 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:47,942 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53020, dest: /127.0.0.1:52451, bytes: 23, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 2080000
2015-03-13 10:32:47,942 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,942 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:47,943 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53019, dest: /127.0.0.1:52444, bytes: 23, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 2883000
2015-03-13 10:32:47,943 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,943 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:47,946 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1
2015-03-13 10:32:47,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0 dst=null perm=null
2015-03-13 10:32:47,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001 dst=null perm=null
2015-03-13 10:32:47,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0 dst=null perm=null
2015-03-13 10:32:47,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000 dst=null perm=null
2015-03-13 10:32:47,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,975 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000002
2015-03-13 10:32:47,975 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000003
2015-03-13 10:32:47,975 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:32:47,975 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:47,975 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000002
2015-03-13 10:32:47,975 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:47,975 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:47,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:47,988 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000002 is : 143
2015-03-13 10:32:47,990 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:47,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081 src: /127.0.0.1:53022 dest: /127.0.0.1:52444
2015-03-13 10:32:47,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:47,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081 src: /127.0.0.1:53023 dest: /127.0.0.1:52451
2015-03-13 10:32:47,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081 src: /127.0.0.1:53024 dest: /127.0.0.1:52454
2015-03-13 10:32:47,999 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist for DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:47,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,001 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:32:48,001 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,001 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000003
2015-03-13 10:32:48,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,014 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000003 is : 143
2015-03-13 10:32:48,020 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:48,029 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,030 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,029 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,029 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,029 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,032 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:48,032 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,034 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,034 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:48,034 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,035 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,035 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,038 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000002 from application application_1426267835672_0007
2015-03-13 10:32:48,041 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,041 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,043 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:48,044 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,046 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000003 from application application_1426267835672_0007
2015-03-13 10:32:48,048 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,048 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,064 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082 src: /127.0.0.1:53025 dest: /127.0.0.1:52454
2015-03-13 10:32:48,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082 src: /127.0.0.1:53027 dest: /127.0.0.1:52444
2015-03-13 10:32:48,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082 src: /127.0.0.1:53028 dest: /127.0.0.1:52451
2015-03-13 10:32:48,079 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53028, dest: /127.0.0.1:52451, bytes: 13, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 10957000
2015-03-13 10:32:48,079 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,080 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,080 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53027, dest: /127.0.0.1:52444, bytes: 13, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 10842000
2015-03-13 10:32:48,080 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,081 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,081 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53025, dest: /127.0.0.1:52454, bytes: 13, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 12179000
2015-03-13 10:32:48,081 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,081 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083 src: /127.0.0.1:53026 dest: /127.0.0.1:52444
2015-03-13 10:32:48,086 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083 src: /127.0.0.1:53029 dest: /127.0.0.1:52454
2015-03-13 10:32:48,087 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1
2015-03-13 10:32:48,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083 src: /127.0.0.1:53030 dest: /127.0.0.1:52451
2015-03-13 10:32:48,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,098 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53030, dest: /127.0.0.1:52451, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 9142000
2015-03-13 10:32:48,099 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,099 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,099 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53029, dest: /127.0.0.1:52454, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 9362000
2015-03-13 10:32:48,099 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,100 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53026, dest: /127.0.0.1:52444, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 10706000
2015-03-13 10:32:48,100 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,104 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1
2015-03-13 10:32:48,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002 dst=null perm=null
2015-03-13 10:32:48,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003 dst=null perm=null
2015-03-13 10:32:48,132 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:48,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,138 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0/part-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:48,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084 src: /127.0.0.1:53031 dest: /127.0.0.1:52444
2015-03-13 10:32:48,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084 src: /127.0.0.1:53032 dest: /127.0.0.1:52454
2015-03-13 10:32:48,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084 src: /127.0.0.1:53033 dest: /127.0.0.1:52447
2015-03-13 10:32:48,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,145 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53033, dest: /127.0.0.1:52447, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 1122000
2015-03-13 10:32:48,146 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,146 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,146 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53032, dest: /127.0.0.1:52454, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 1610000
2015-03-13 10:32:48,146 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,147 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,147 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53031, dest: /127.0.0.1:52444, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 2414000
2015-03-13 10:32:48,147 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,150 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0/part-00002 is closed by DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1
2015-03-13 10:32:48,155 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0/part-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:48,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085 src: /127.0.0.1:53034 dest: /127.0.0.1:52444
2015-03-13 10:32:48,158 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085 src: /127.0.0.1:53035 dest: /127.0.0.1:52454
2015-03-13 10:32:48,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085 src: /127.0.0.1:53036 dest: /127.0.0.1:52451
2015-03-13 10:32:48,162 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53036, dest: /127.0.0.1:52451, bytes: 22, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 1382000
2015-03-13 10:32:48,163 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,163 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,163 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53035, dest: /127.0.0.1:52454, bytes: 22, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 1958000
2015-03-13 10:32:48,163 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,164 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53034, dest: /127.0.0.1:52444, bytes: 22, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 2766000
2015-03-13 10:32:48,164 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,168 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0/part-00003 is closed by DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1
2015-03-13 10:32:48,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0 dst=null perm=null
2015-03-13 10:32:48,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002 dst=null perm=null
2015-03-13 10:32:48,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,190 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000004
2015-03-13 10:32:48,190 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:48,190 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:32:48,190 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:48,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000002
2015-03-13 10:32:48,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:48,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000003
2015-03-13 10:32:48,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:48,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:48,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:48,194 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:32:48,194 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:48,194 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:32:48,194 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:32:48,194 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000002, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,194 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,194 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:32:48,194 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000002 on node: host: 10.1.1.144:52469 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:32:48,194 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:48,194 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:32:48,195 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:48,195 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:32:48,195 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:32:48,195 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,195 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,195 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:32:48,195 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000003 on node: host: 10.1.1.144:52469 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:32:48,196 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000004
2015-03-13 10:32:48,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0 dst=null perm=null
2015-03-13 10:32:48,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003 dst=null perm=null
2015-03-13 10:32:48,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,211 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000004 is : 143
2015-03-13 10:32:48,220 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000005
2015-03-13 10:32:48,220 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:48,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:32:48,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:48,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,226 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,229 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,229 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:32:48,230 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,230 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1 dst=null perm=null
2015-03-13 10:32:48,230 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,231 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000005
2015-03-13 10:32:48,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000 dst=null perm=null
2015-03-13 10:32:48,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000 dst=null perm=null
2015-03-13 10:32:48,245 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000005 is : 143
2015-03-13 10:32:48,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001 dst=null perm=null
2015-03-13 10:32:48,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001 dst=null perm=null
2015-03-13 10:32:48,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002 dst=null perm=null
2015-03-13 10:32:48,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002 dst=null perm=null
2015-03-13 10:32:48,259 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:48,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,260 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,263 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,263 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000004 from application application_1426267835672_0007
2015-03-13 10:32:48,263 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,263 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:48,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003 dst=null perm=null
2015-03-13 10:32:48,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003 dst=null perm=null
2015-03-13 10:32:48,267 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,268 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,269 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:48,269 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,270 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000005 from application application_1426267835672_0007
2015-03-13 10:32:48,270 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,271 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:48,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,279 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,283 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,295 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53024, dest: /127.0.0.1:52454, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 298846000
2015-03-13 10:32:48,295 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,298 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:48,298 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53023, dest: /127.0.0.1:52451, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 301425000
2015-03-13 10:32:48,298 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,298 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:48,299 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53022, dest: /127.0.0.1:52444, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 302292000
2015-03-13 10:32:48,299 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,299 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:48,300 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,304 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:48,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086 src: /127.0.0.1:53037 dest: /127.0.0.1:52451
2015-03-13 10:32:48,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086 src: /127.0.0.1:53038 dest: /127.0.0.1:52454
2015-03-13 10:32:48,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086 src: /127.0.0.1:53039 dest: /127.0.0.1:52444
2015-03-13 10:32:48,313 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53039, dest: /127.0.0.1:52444, bytes: 438, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 1942000
2015-03-13 10:32:48,313 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,315 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53038, dest: /127.0.0.1:52454, bytes: 438, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 3018000
2015-03-13 10:32:48,315 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,315 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:48,316 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53037, dest: /127.0.0.1:52451, bytes: 438, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 4760000
2015-03-13 10:32:48,316 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,317 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:48,317 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:48,320 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist dst=null perm=null
2015-03-13 10:32:48,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:32:48,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist dst=null perm=null
2015-03-13 10:32:48,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:32:48,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist dst=null perm=null
2015-03-13 10:32:48,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53040, bytes: 47461, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 220000
2015-03-13 10:32:48,343 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:48,345 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087 src: /127.0.0.1:53041 dest: /127.0.0.1:52451
2015-03-13 10:32:48,352 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087 src: /127.0.0.1:53042 dest: /127.0.0.1:52444
2015-03-13 10:32:48,353 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087 src: /127.0.0.1:53043 dest: /127.0.0.1:52447
2015-03-13 10:32:48,357 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53043, dest: /127.0.0.1:52447, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, duration: 1739000
2015-03-13 10:32:48,357 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,357 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,357 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53042, dest: /127.0.0.1:52444, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, duration: 2421000
2015-03-13 10:32:48,358 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,358 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,358 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53041, dest: /127.0.0.1:52451, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, duration: 3375000
2015-03-13 10:32:48,358 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,360 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml dst=null perm=null
2015-03-13 10:32:48,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp dst=null perm=null
2015-03-13 10:32:48,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml dst=null perm=null
2015-03-13 10:32:48,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp dst=null perm=null
2015-03-13 10:32:48,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml dst=null perm=null
2015-03-13 10:32:48,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53044, bytes: 90690, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 345000
2015-03-13 10:32:48,375 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:48,377 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088 src: /127.0.0.1:53045 dest: /127.0.0.1:52454
2015-03-13 10:32:48,379 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088 src: /127.0.0.1:53046 dest: /127.0.0.1:52444
2015-03-13 10:32:48,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088 src: /127.0.0.1:53047 dest: /127.0.0.1:52447
2015-03-13 10:32:48,384 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53047, dest: /127.0.0.1:52447, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, duration: 1685000
2015-03-13 10:32:48,384 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,384 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,385 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53046, dest: /127.0.0.1:52444, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, duration: 2345000
2015-03-13 10:32:48,385 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,385 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,385 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53045, dest: /127.0.0.1:52454, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, duration: 3176000
2015-03-13 10:32:48,386 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,386 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,388 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,402 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from RUNNING to FINISHING
2015-03-13 10:32:48,402 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0007
2015-03-13 10:32:48,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from RUNNING to REMOVING
2015-03-13 10:32:48,402 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0007
2015-03-13 10:32:48,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from REMOVING to FINISHING
2015-03-13 10:32:49,135 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:49,226 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:49,227 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000004
2015-03-13 10:32:49,227 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:49,227 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000005
2015-03-13 10:32:49,228 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:49,228 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:32:49,228 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:49,229 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:32:49,229 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:32:49,229 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000004, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,229 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,230 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:49,230 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000004 on node: host: 10.1.1.144:52469 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:32:49,230 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:49,230 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:32:49,230 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:49,230 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:49,231 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:49,231 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000005, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,231 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,231 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:49,231 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000005 on node: host: 10.1.1.144:52469 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:49,408 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741896_1072 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52447
2015-03-13 10:32:49,408 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52447
2015-03-13 10:32:49,408 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741898_1074 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451
2015-03-13 10:32:49,408 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741899_1075 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:32:49,408 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454
2015-03-13 10:32:49,409 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741900_1076 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:32:49,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007 dst=null perm=null
2015-03-13 10:32:49,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,445 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary
2015-03-13 10:32:49,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:49,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,446 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary
2015-03-13 10:32:49,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:49,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary dst=null perm=null
2015-03-13 10:32:49,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:49,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:49,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,460 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:32:49,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000 dst=null perm=null
2015-03-13 10:32:49,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 27, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 148000
2015-03-13 10:32:49,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001 dst=null perm=null
2015-03-13 10:32:49,466 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 160000
2015-03-13 10:32:49,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002 dst=null perm=null
2015-03-13 10:32:49,469 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 172000
2015-03-13 10:32:49,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003 dst=null perm=null
2015-03-13 10:32:49,471 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 26, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 152000
2015-03-13 10:32:49,484 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,484 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:49,485 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:49,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,489 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:32:49,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:49,492 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 149000
2015-03-13 10:32:49,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001 dst=null perm=null
2015-03-13 10:32:49,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 120000
2015-03-13 10:32:49,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002 dst=null perm=null
2015-03-13 10:32:49,496 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 17, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 120000
2015-03-13 10:32:49,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003 dst=null perm=null
2015-03-13 10:32:49,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 121000
2015-03-13 10:32:49,498 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allchain/trap-nondeterministic
2015-03-13 10:32:49,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:49,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000 dst=null perm=null
2015-03-13 10:32:49,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 188000
2015-03-13 10:32:49,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001 dst=null perm=null
2015-03-13 10:32:49,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001 dst=null perm=null
2015-03-13 10:32:49,507 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53052, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 185000
2015-03-13 10:32:49,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002 dst=null perm=null
2015-03-13 10:32:49,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002 dst=null perm=null
2015-03-13 10:32:49,509 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 17, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 152000
2015-03-13 10:32:49,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003 dst=null perm=null
2015-03-13 10:32:49,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003 dst=null perm=null
2015-03-13 10:32:49,512 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 157000
2015-03-13 10:32:49,513 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allchain/tap-nondeterministic
2015-03-13 10:32:49,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic dst=null perm=null
2015-03-13 10:32:49,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000 dst=null perm=null
2015-03-13 10:32:49,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000 dst=null perm=null
2015-03-13 10:32:49,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 27, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 151000
2015-03-13 10:32:49,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001 dst=null perm=null
2015-03-13 10:32:49,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001 dst=null perm=null
2015-03-13 10:32:49,523 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53052, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 125000
2015-03-13 10:32:49,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002 dst=null perm=null
2015-03-13 10:32:49,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002 dst=null perm=null
2015-03-13 10:32:49,526 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 128000
2015-03-13 10:32:49,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003 dst=null perm=null
2015-03-13 10:32:49,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003 dst=null perm=null
2015-03-13 10:32:49,529 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 26, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 125000
2015-03-13 10:32:49,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:49,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,542 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:32:49,543 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:32:49,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:32:49,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:32:49,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:32:49,560 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:32:49,560 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap"]
2015-03-13 10:32:49,560 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:32:49,560 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:32:49,560 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:32:49,561 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...-mr1/trapplatform/seq/tap
2015-03-13 10:32:49,569 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:49,577 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:49,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:32:49,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:49,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:49,583 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 8
2015-03-13 10:32:49,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008 dst=null perm=null
2015-03-13 10:32:49,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:32:49,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:32:49,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:49,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,590 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:49,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53054 dest: /127.0.0.1:52454
2015-03-13 10:32:49,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53055 dest: /127.0.0.1:52451
2015-03-13 10:32:49,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53056 dest: /127.0.0.1:52444
2015-03-13 10:32:49,597 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53056, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 2618000
2015-03-13 10:32:49,597 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,598 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,598 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53055, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 2623000
2015-03-13 10:32:49,598 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,598 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,599 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53054, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 3523000
2015-03-13 10:32:49,599 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,600 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,601 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,601 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar
2015-03-13 10:32:49,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:49,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:49,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:49,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:49,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:32:49,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:32:49,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:32:49,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:32:49,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:32:49,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:49,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:49,610 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:49,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:32:49,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,615 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split
2015-03-13 10:32:49,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:32:49,616 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:49,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53057 dest: /127.0.0.1:52451
2015-03-13 10:32:49,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53058 dest: /127.0.0.1:52444
2015-03-13 10:32:49,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53059 dest: /127.0.0.1:52447
2015-03-13 10:32:49,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53060 dest: /127.0.0.1:52454
2015-03-13 10:32:49,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53060, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 1744000
2015-03-13 10:32:49,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,625 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53059, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 2205000
2015-03-13 10:32:49,625 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,626 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53058, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 3207000
2015-03-13 10:32:49,626 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,626 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,626 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53057, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 3693000
2015-03-13 10:32:49,627 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,628 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,628 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,633 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:49,634 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091 src: /127.0.0.1:53061 dest: /127.0.0.1:52444
2015-03-13 10:32:49,636 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091 src: /127.0.0.1:53062 dest: /127.0.0.1:52454
2015-03-13 10:32:49,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091 src: /127.0.0.1:53063 dest: /127.0.0.1:52451
2015-03-13 10:32:49,640 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53063, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 1155000
2015-03-13 10:32:49,640 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,640 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:49,640 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53062, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 1468000
2015-03-13 10:32:49,641 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,641 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:49,641 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53061, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 2308000
2015-03-13 10:32:49,642 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,642 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:49,643 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,644 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:32:49,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,647 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:49,648 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:49,652 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:49,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092 src: /127.0.0.1:53064 dest: /127.0.0.1:52454
2015-03-13 10:32:49,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092 src: /127.0.0.1:53065 dest: /127.0.0.1:52451
2015-03-13 10:32:49,655 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092 src: /127.0.0.1:53066 dest: /127.0.0.1:52444
2015-03-13 10:32:49,658 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53066, dest: /127.0.0.1:52444, bytes: 98752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 1652000
2015-03-13 10:32:49,659 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,659 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,659 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53065, dest: /127.0.0.1:52451, bytes: 98752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 2269000
2015-03-13 10:32:49,660 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,660 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,660 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53064, dest: /127.0.0.1:52454, bytes: 98752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 3083000
2015-03-13 10:32:49,660 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,662 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,662 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0008
2015-03-13 10:32:49,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008 dst=null perm=null
2015-03-13 10:32:49,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:49,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:49,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:49,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:49,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:32:49,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:32:49,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:49,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:49,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:49,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:49,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:49,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:49,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:49,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:49,680 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 8 submitted by user soberoi
2015-03-13 10:32:49,680 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0008
2015-03-13 10:32:49,680 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0008
2015-03-13 10:32:49,681 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0008
2015-03-13 10:32:49,681 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from NEW to NEW_SAVING
2015-03-13 10:32:49,681 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:32:49,681 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0008_000001
2015-03-13 10:32:49,681 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from NEW to SUBMITTED
2015-03-13 10:32:49,682 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0008 from user: soberoi activated in queue: default
2015-03-13 10:32:49,682 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0008 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:32:49,682 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0008 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:32:49,682 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0008 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:49,682 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0008_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:32:49,682 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:32:49,683 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from SUBMITTED to ACCEPTED
2015-03-13 10:32:49,685 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0008/
2015-03-13 10:32:49,685 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0008
2015-03-13 10:32:49,685 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0008/
2015-03-13 10:32:50,139 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:50,140 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:50,140 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:32:50,140 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:32:50,141 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0008_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:50,141 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:32:50,141 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:50,141 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:50,142 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0008 AttemptId: appattempt_1426267835672_0008_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:32:50,142 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:32:50,143 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0008_000001
2015-03-13 10:32:50,143 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:32:50,143 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0008_000001
2015-03-13 10:32:50,143 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0008_000001
2015-03-13 10:32:50,144 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0008_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:32:50,146 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:32:50,148 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000001 by user soberoi
2015-03-13 10:32:50,148 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0008
2015-03-13 10:32:50,148 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:32:50,148 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from NEW to INITING
2015-03-13 10:32:50,148 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000001 to application application_1426267835672_0008
2015-03-13 10:32:50,149 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0008_000001
2015-03-13 10:32:50,149 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from INITING to RUNNING
2015-03-13 10:32:50,149 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:32:50,149 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:32:50,149 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:50,149 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,149 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,149 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,150 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,150 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000001
2015-03-13 10:32:50,160 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0008_01_000001.tokens. Credentials list:
2015-03-13 10:32:50,175 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:50,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0008_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001.tokens
2015-03-13 10:32:50,246 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:50,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:50,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:50,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:50,314 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 438000
2015-03-13 10:32:50,332 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:50,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:50,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:50,355 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 177000
2015-03-13 10:32:50,367 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:32:50,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:32:50,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:32:50,390 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 159000
2015-03-13 10:32:50,402 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:50,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:50,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:50,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 99524, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 253000
2015-03-13 10:32:50,437 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,437 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:50,463 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:50,463 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:50,529 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001/default_container_executor.sh]
2015-03-13 10:32:50,806 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:50,806 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081
2015-03-13 10:32:50,807 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084
2015-03-13 10:32:50,819 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079
2015-03-13 10:32:50,820 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084
2015-03-13 10:32:50,820 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087
2015-03-13 10:32:50,821 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088
2015-03-13 10:32:50,821 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078
2015-03-13 10:32:50,822 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077
2015-03-13 10:32:50,822 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080
2015-03-13 10:32:50,822 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,010 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092
2015-03-13 10:32:51,010 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079
2015-03-13 10:32:51,011 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078
2015-03-13 10:32:51,011 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085
2015-03-13 10:32:51,012 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,012 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091
2015-03-13 10:32:51,012 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086
2015-03-13 10:32:51,013 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083
2015-03-13 10:32:51,013 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082
2015-03-13 10:32:51,014 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088
2015-03-13 10:32:51,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082
2015-03-13 10:32:51,045 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083
2015-03-13 10:32:51,068 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080
2015-03-13 10:32:51,069 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,070 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:51,071 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079
2015-03-13 10:32:51,071 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086
2015-03-13 10:32:51,071 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091
2015-03-13 10:32:51,072 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087
2015-03-13 10:32:51,072 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083
2015-03-13 10:32:51,072 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077
2015-03-13 10:32:51,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078
2015-03-13 10:32:51,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085
2015-03-13 10:32:51,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081
2015-03-13 10:32:51,074 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082
2015-03-13 10:32:51,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:51,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:51,143 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:51,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:51,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,251 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080
2015-03-13 10:32:51,252 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088
2015-03-13 10:32:51,252 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081
2015-03-13 10:32:51,253 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086
2015-03-13 10:32:51,254 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087
2015-03-13 10:32:51,271 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092
2015-03-13 10:32:51,445 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091
2015-03-13 10:32:51,446 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092
2015-03-13 10:32:51,446 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077
2015-03-13 10:32:51,447 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085
2015-03-13 10:32:51,447 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084
2015-03-13 10:32:51,976 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52454 to replicate blk_1073741913_1089 to datanode(s) 127.0.0.1:52447
2015-03-13 10:32:51,976 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741905_1081, blk_1073741896_1072, blk_1073741897_1073, blk_1073741899_1075, blk_1073741900_1076]
2015-03-13 10:32:51,977 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741905_1081, blk_1073741896_1072, blk_1073741897_1073, blk_1073741898_1074]
2015-03-13 10:32:52,146 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:52,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:52,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:32:52,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_STARTED dst=null perm=null
2015-03-13 10:32:52,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:32:52,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_FAIL dst=null perm=null
2015-03-13 10:32:52,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008 dst=null perm=null
2015-03-13 10:32:52,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:32:52,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:32:52,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:52,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905 for deletion
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:52,625 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898 for deletion
2015-03-13 10:32:52,626 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898
2015-03-13 10:32:52,628 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53071, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 187000
2015-03-13 10:32:53,003 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 to 127.0.0.1:52447
2015-03-13 10:32:53,004 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905 for deletion
2015-03-13 10:32:53,004 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:53,004 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:53,004 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899 for deletion
2015-03-13 10:32:53,004 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905
2015-03-13 10:32:53,005 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:53,005 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:53,005 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899
2015-03-13 10:32:53,004 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900 for deletion
2015-03-13 10:32:53,005 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:32:53,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53074 dest: /127.0.0.1:52447
2015-03-13 10:32:53,006 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900
2015-03-13 10:32:53,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53074 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:32:53,008 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741913_1089 size 254067
2015-03-13 10:32:53,148 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:53,148 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:53,420 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:32:53,422 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0008_000001
2015-03-13 10:32:53,422 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0008 APPATTEMPTID=appattempt_1426267835672_0008_000001
2015-03-13 10:32:53,422 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:53,422 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from ACCEPTED to RUNNING
2015-03-13 10:32:53,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:53,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:53,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:53,646 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:53,689 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093 src: /127.0.0.1:53078 dest: /127.0.0.1:52451
2015-03-13 10:32:53,690 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093 src: /127.0.0.1:53079 dest: /127.0.0.1:52454
2015-03-13 10:32:53,692 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093 src: /127.0.0.1:53080 dest: /127.0.0.1:52444
2015-03-13 10:32:53,699 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53080, dest: /127.0.0.1:52444, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 5758000
2015-03-13 10:32:53,699 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:53,700 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:53,700 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53079, dest: /127.0.0.1:52454, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 6660000
2015-03-13 10:32:53,700 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:53,701 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53078, dest: /127.0.0.1:52451, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 7518000
2015-03-13 10:32:53,701 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:53,701 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:53,702 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:53,705 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:32:54,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:54,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:54,543 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0007_01_000001 succeeded
2015-03-13 10:32:54,543 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:54,543 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:54,551 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000001 from application application_1426267835672_0007
2015-03-13 10:32:54,552 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:54,552 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:54,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,643 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,643 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:32:54,644 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:54,644 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,644 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:54,644 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,645 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,645 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:32:54,645 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:32:54,646 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,646 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:32:54,646 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,646 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:32:54,646 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:32:54,646 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,647 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:32:54,647 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,647 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,647 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:32:54,647 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:32:54,647 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,647 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:32:54,647 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,983 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741905_1081, blk_1073741896_1072, blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076]
2015-03-13 10:32:54,983 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741896_1072, blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076]
2015-03-13 10:32:55,154 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:55,154 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000001
2015-03-13 10:32:55,155 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,155 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:55,156 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0007_000001
2015-03-13 10:32:55,156 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:55,156 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:55,156 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0007 CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:55,156 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from FINISHING to FINISHED
2015-03-13 10:32:55,156 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:32:55,157 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0007
2015-03-13 10:32:55,157 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:32:55,157 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0007,name=[F2851B067A5340D8BCD42F553ADE00B9/2D32D0260D4B4807B8F7ECFBFF3D0CCC] trap test/(1/1) ...hain/tap-nondeterministic,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0007/jobhistory/job/job_1426267835672_0007,appMasterHost=Edinburgh.local,startTime=1426267954642,finishTime=1426267968402,finalStatus=SUCCEEDED
2015-03-13 10:32:55,157 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0007_000001
2015-03-13 10:32:55,157 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:55,157 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:55,158 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:32:55,158 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000001 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:32:55,158 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0007_000001 is done. finalState=FINISHED
2015-03-13 10:32:55,158 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0007 requests cleared
2015-03-13 10:32:55,158 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0007 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:55,158 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0007 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:55,160 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:55,162 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000001
2015-03-13 10:32:55,242 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:55,242 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,243 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0007
2015-03-13 10:32:55,243 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,243 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:55,243 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0007, with delay of 10800 seconds
2015-03-13 10:32:55,243 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,461 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,462 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,462 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,462 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:55,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:55,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:55,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:55,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:55,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:55,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:55,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:55,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:32:55,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:32:55,587 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:32:55,590 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000004 by user soberoi
2015-03-13 10:32:55,590 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000005 by user soberoi
2015-03-13 10:32:55,590 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000003 by user soberoi
2015-03-13 10:32:55,591 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000005 to application application_1426267835672_0008
2015-03-13 10:32:55,591 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:32:55,590 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000002 by user soberoi
2015-03-13 10:32:55,601 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:32:55,590 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0008
2015-03-13 10:32:55,601 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:32:55,591 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000003 to application application_1426267835672_0008
2015-03-13 10:32:55,602 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000002 to application application_1426267835672_0008
2015-03-13 10:32:55,602 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from NEW to INITING
2015-03-13 10:32:55,602 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000004 to application application_1426267835672_0008
2015-03-13 10:32:55,602 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from INITING to RUNNING
2015-03-13 10:32:55,591 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:32:55,602 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,603 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,603 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,603 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,604 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:55,604 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:55,604 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,604 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,604 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,604 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,604 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,604 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,605 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,605 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,605 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,605 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,605 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,605 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,605 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000002
2015-03-13 10:32:55,606 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000004
2015-03-13 10:32:55,607 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000005
2015-03-13 10:32:55,608 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000003
2015-03-13 10:32:55,627 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000002.tokens. Credentials list:
2015-03-13 10:32:55,627 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000005.tokens. Credentials list:
2015-03-13 10:32:55,627 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000003.tokens. Credentials list:
2015-03-13 10:32:55,627 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:55,627 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000004.tokens. Credentials list:
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898 for deletion
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899 for deletion
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900 for deletion
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:55,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898
2015-03-13 10:32:55,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899
2015-03-13 10:32:55,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900
2015-03-13 10:32:55,644 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:55,644 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002.tokens
2015-03-13 10:32:55,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:55,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:55,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:55,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar dst=null perm=null
2015-03-13 10:32:55,785 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53085, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1146162549_4153, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 468000
2015-03-13 10:32:55,804 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:55,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:55,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:55,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml dst=null perm=null
2015-03-13 10:32:55,827 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:55,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53085, bytes: 99524, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1146162549_4153, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 298000
2015-03-13 10:32:55,842 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:55,842 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,842 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,843 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,843 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,861 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905 for deletion
2015-03-13 10:32:55,862 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:55,862 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:55,862 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898 for deletion
2015-03-13 10:32:55,862 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899 for deletion
2015-03-13 10:32:55,862 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900 for deletion
2015-03-13 10:32:55,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905
2015-03-13 10:32:55,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:55,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898
2015-03-13 10:32:55,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900
2015-03-13 10:32:55,863 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:55,864 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899
2015-03-13 10:32:55,886 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,886 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,886 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,886 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,887 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,887 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,887 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,887 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004/default_container_executor.sh]
2015-03-13 10:32:55,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002/default_container_executor.sh]
2015-03-13 10:32:55,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003/default_container_executor.sh]
2015-03-13 10:32:55,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005/default_container_executor.sh]
2015-03-13 10:32:56,022 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093
2015-03-13 10:32:56,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,161 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:56,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,161 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0007
2015-03-13 10:32:56,161 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:56,161 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0007, with delay of 10800 seconds
2015-03-13 10:32:56,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,275 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093
2015-03-13 10:32:56,451 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093
2015-03-13 10:32:56,477 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:32:56,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,870 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:56,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004.tokens
2015-03-13 10:32:56,994 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:57,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:57,162 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003.tokens
2015-03-13 10:32:57,219 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:57,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:57,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005.tokens
2015-03-13 10:32:57,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:57,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,165 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,660 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,661 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,661 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,661 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,171 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,666 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,174 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,669 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,669 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,669 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,176 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,674 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,178 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:33:02,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:33:02,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:33:02,353 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53096, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 172000
2015-03-13 10:33:02,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split dst=null perm=null
2015-03-13 10:33:02,381 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53097, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 169000
2015-03-13 10:33:02,440 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53099, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 122000
2015-03-13 10:33:02,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:02,479 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53101, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 247000
2015-03-13 10:33:02,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:02,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53100, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 156000
2015-03-13 10:33:02,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:02,548 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53102, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 636000
2015-03-13 10:33:02,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:02,595 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53100, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 165000
2015-03-13 10:33:02,676 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,677 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,677 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,677 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,900 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53097, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 167000
2015-03-13 10:33:02,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:02,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:02,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:02,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:02,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:02,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:02,961 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:02,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:02,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:02,986 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:03,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094 src: /127.0.0.1:53103 dest: /127.0.0.1:52444
2015-03-13 10:33:03,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094 src: /127.0.0.1:53105 dest: /127.0.0.1:52454
2015-03-13 10:33:03,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094 src: /127.0.0.1:53106 dest: /127.0.0.1:52451
2015-03-13 10:33:03,020 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53106, dest: /127.0.0.1:52451, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 7084000
2015-03-13 10:33:03,020 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,020 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,021 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53105, dest: /127.0.0.1:52454, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 7933000
2015-03-13 10:33:03,021 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,021 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,021 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53103, dest: /127.0.0.1:52444, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 8819000
2015-03-13 10:33:03,022 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,022 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,026 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1
2015-03-13 10:33:03,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095 src: /127.0.0.1:53104 dest: /127.0.0.1:52444
2015-03-13 10:33:03,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095 src: /127.0.0.1:53107 dest: /127.0.0.1:52451
2015-03-13 10:33:03,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095 src: /127.0.0.1:53108 dest: /127.0.0.1:52447
2015-03-13 10:33:03,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,045 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53108, dest: /127.0.0.1:52447, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 6788000
2015-03-13 10:33:03,045 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,045 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:03,045 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53107, dest: /127.0.0.1:52451, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 7047000
2015-03-13 10:33:03,046 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,046 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:03,046 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53104, dest: /127.0.0.1:52444, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 8555000
2015-03-13 10:33:03,047 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,047 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:03,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000 dst=null perm=null
2015-03-13 10:33:03,051 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1
2015-03-13 10:33:03,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,066 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:03,069 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:03,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000000_0 dst=null perm=null
2015-03-13 10:33:03,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001 dst=null perm=null
2015-03-13 10:33:03,125 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096 src: /127.0.0.1:53109 dest: /127.0.0.1:52447
2015-03-13 10:33:03,127 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096 src: /127.0.0.1:53111 dest: /127.0.0.1:52444
2015-03-13 10:33:03,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,128 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096 src: /127.0.0.1:53112 dest: /127.0.0.1:52451
2015-03-13 10:33:03,140 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53112, dest: /127.0.0.1:52451, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 9754000
2015-03-13 10:33:03,144 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097 src: /127.0.0.1:53110 dest: /127.0.0.1:52447
2015-03-13 10:33:03,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,145 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53111, dest: /127.0.0.1:52444, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 14895000
2015-03-13 10:33:03,146 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,146 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,146 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53109, dest: /127.0.0.1:52447, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 15996000
2015-03-13 10:33:03,146 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097 src: /127.0.0.1:53113 dest: /127.0.0.1:52444
2015-03-13 10:33:03,147 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097 src: /127.0.0.1:53114 dest: /127.0.0.1:52451
2015-03-13 10:33:03,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,157 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1
2015-03-13 10:33:03,159 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000002
2015-03-13 10:33:03,160 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:33:03,160 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,160 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000002
2015-03-13 10:33:03,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:03,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,161 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,161 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,172 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000002 is : 143
2015-03-13 10:33:03,174 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:03,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098 src: /127.0.0.1:53115 dest: /127.0.0.1:52444
2015-03-13 10:33:03,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098 src: /127.0.0.1:53116 dest: /127.0.0.1:52451
2015-03-13 10:33:03,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,179 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098 src: /127.0.0.1:53117 dest: /127.0.0.1:52454
2015-03-13 10:33:03,186 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist for DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:03,187 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,188 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:33:03,188 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,188 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000002 from application application_1426267835672_0008
2015-03-13 10:33:03,189 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,189 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:03,189 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,189 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,207 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53114, dest: /127.0.0.1:52451, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 57371000
2015-03-13 10:33:03,207 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000001_0 dst=null perm=null
2015-03-13 10:33:03,208 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,208 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53113, dest: /127.0.0.1:52444, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 58001000
2015-03-13 10:33:03,208 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,208 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,209 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53110, dest: /127.0.0.1:52447, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 58962000
2015-03-13 10:33:03,209 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,209 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,218 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000003
2015-03-13 10:33:03,218 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:33:03,218 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002 dst=null perm=null
2015-03-13 10:33:03,218 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000003
2015-03-13 10:33:03,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:03,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000002
2015-03-13 10:33:03,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:03,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:03,220 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:03,220 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:33:03,221 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:33:03,221 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:03,221 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,221 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,221 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:03,221 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000002 on node: host: 10.1.1.144:52473 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:03,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,232 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000003 is : 143
2015-03-13 10:33:03,236 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1
2015-03-13 10:33:03,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,244 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,245 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,245 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,245 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,245 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,246 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:33:03,246 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,246 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000003 from application application_1426267835672_0008
2015-03-13 10:33:03,246 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,246 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:03,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:03,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000002_0 dst=null perm=null
2015-03-13 10:33:03,283 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000004
2015-03-13 10:33:03,283 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:33:03,283 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:03,284 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000004
2015-03-13 10:33:03,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000003
2015-03-13 10:33:03,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:03,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,285 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:03,285 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:03,285 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:33:03,285 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:33:03,285 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:03,285 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,286 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,286 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:03,286 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000003 on node: host: 10.1.1.144:52473 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:03,297 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000004 is : 143
2015-03-13 10:33:03,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000003_0 dst=null perm=null
2015-03-13 10:33:03,311 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000005
2015-03-13 10:33:03,311 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:33:03,312 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:33:03,312 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,312 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,313 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,314 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,314 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,315 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,316 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000005
2015-03-13 10:33:03,332 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000005 is : 143
2015-03-13 10:33:03,346 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:33:03,346 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,346 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,346 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000004 from application application_1426267835672_0008
2015-03-13 10:33:03,346 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,346 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:03,347 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:33:03,347 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,347 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,347 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,347 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,348 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000005 from application application_1426267835672_0008
2015-03-13 10:33:03,347 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,348 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,349 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:04,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:04,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:04,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000004
2015-03-13 10:33:04,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:04,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000005
2015-03-13 10:33:04,315 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:04,315 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:04,315 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:33:04,315 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:04,316 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:04,316 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,316 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,316 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:04,316 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000004 on node: host: 10.1.1.144:52473 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:04,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:04,317 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:04,317 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:33:04,317 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:04,317 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:04,317 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,317 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,318 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:04,318 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000005 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:05,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:05,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:05,190 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:05,190 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:33:05,190 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0008_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:05,191 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:05,191 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:05,522 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:05,534 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:33:05,536 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000006 by user soberoi
2015-03-13 10:33:05,537 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:05,537 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000006 to application application_1426267835672_0008
2015-03-13 10:33:05,537 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:33:05,537 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:33:05,537 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:33:05,537 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:05,538 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:33:05,538 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:05,565 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:05,565 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:05,653 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006/default_container_executor.sh]
2015-03-13 10:33:05,839 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095
2015-03-13 10:33:05,839 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096
2015-03-13 10:33:05,840 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097
2015-03-13 10:33:06,028 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094
2015-03-13 10:33:06,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:06,195 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:06,195 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:06,283 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096
2015-03-13 10:33:06,283 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097
2015-03-13 10:33:06,284 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095
2015-03-13 10:33:06,284 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094
2015-03-13 10:33:06,457 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096
2015-03-13 10:33:06,457 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097
2015-03-13 10:33:06,457 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095
2015-03-13 10:33:06,457 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094
2015-03-13 10:33:06,528 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:33:07,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:07,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:08,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,078 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0008_r_000000_0_1777241589_1
2015-03-13 10:33:08,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0 dst=null perm=null
2015-03-13 10:33:08,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0 dst=null perm=null
2015-03-13 10:33:08,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000 dst=null perm=null
2015-03-13 10:33:08,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:08,102 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000006
2015-03-13 10:33:08,102 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:08,102 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:33:08,102 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000006
2015-03-13 10:33:08,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:08,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:08,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,109 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,113 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000006 is : 143
2015-03-13 10:33:08,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1 dst=null perm=null
2015-03-13 10:33:08,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:08,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:08,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000 dst=null perm=null
2015-03-13 10:33:08,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000 dst=null perm=null
2015-03-13 10:33:08,123 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:08,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:08,125 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:08,125 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000006 from application application_1426267835672_0008
2015-03-13 10:33:08,125 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:08,125 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:08,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary dst=null perm=null
2015-03-13 10:33:08,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,136 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,139 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,152 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53117, dest: /127.0.0.1:52454, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 4971091000
2015-03-13 10:33:08,152 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:08,153 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53116, dest: /127.0.0.1:52451, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 4970801000
2015-03-13 10:33:08,153 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,154 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:08,154 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53115, dest: /127.0.0.1:52444, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 4972718000
2015-03-13 10:33:08,155 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,156 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:08,157 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,161 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:08,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099 src: /127.0.0.1:53122 dest: /127.0.0.1:52451
2015-03-13 10:33:08,164 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099 src: /127.0.0.1:53123 dest: /127.0.0.1:52444
2015-03-13 10:33:08,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099 src: /127.0.0.1:53124 dest: /127.0.0.1:52447
2015-03-13 10:33:08,168 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53124, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 1322000
2015-03-13 10:33:08,168 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,168 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:08,168 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53123, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 1673000
2015-03-13 10:33:08,169 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,169 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:08,169 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53122, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 2649000
2015-03-13 10:33:08,169 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,170 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:08,171 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist dst=null perm=null
2015-03-13 10:33:08,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:33:08,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist dst=null perm=null
2015-03-13 10:33:08,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:33:08,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist dst=null perm=null
2015-03-13 10:33:08,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53125, bytes: 58230, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 211000
2015-03-13 10:33:08,189 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:08,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100 src: /127.0.0.1:53126 dest: /127.0.0.1:52444
2015-03-13 10:33:08,192 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100 src: /127.0.0.1:53127 dest: /127.0.0.1:52447
2015-03-13 10:33:08,193 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100 src: /127.0.0.1:53128 dest: /127.0.0.1:52451
2015-03-13 10:33:08,196 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53128, dest: /127.0.0.1:52451, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, duration: 1659000
2015-03-13 10:33:08,196 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,197 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,197 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53127, dest: /127.0.0.1:52447, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, duration: 2197000
2015-03-13 10:33:08,197 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,197 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,198 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53126, dest: /127.0.0.1:52444, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, duration: 3138000
2015-03-13 10:33:08,198 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,198 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,199 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml dst=null perm=null
2015-03-13 10:33:08,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp dst=null perm=null
2015-03-13 10:33:08,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml dst=null perm=null
2015-03-13 10:33:08,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp dst=null perm=null
2015-03-13 10:33:08,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml dst=null perm=null
2015-03-13 10:33:08,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53125, bytes: 92066, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 394000
2015-03-13 10:33:08,211 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:08,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101 src: /127.0.0.1:53129 dest: /127.0.0.1:52444
2015-03-13 10:33:08,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101 src: /127.0.0.1:53130 dest: /127.0.0.1:52454
2015-03-13 10:33:08,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101 src: /127.0.0.1:53131 dest: /127.0.0.1:52451
2015-03-13 10:33:08,220 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53131, dest: /127.0.0.1:52451, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, duration: 1967000
2015-03-13 10:33:08,220 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,221 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53130, dest: /127.0.0.1:52454, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, duration: 2382000
2015-03-13 10:33:08,221 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,221 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53129, dest: /127.0.0.1:52444, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, duration: 3345000
2015-03-13 10:33:08,222 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,222 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,223 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,239 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from RUNNING to FINISHING
2015-03-13 10:33:08,239 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0008
2015-03-13 10:33:08,239 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from RUNNING to REMOVING
2015-03-13 10:33:08,239 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0008
2015-03-13 10:33:08,239 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from REMOVING to FINISHING
2015-03-13 10:33:09,105 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:09,105 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:09,106 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000006
2015-03-13 10:33:09,106 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:09,106 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:33:09,107 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:09,107 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:09,107 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:09,107 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:09,108 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:09,108 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:09,108 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000006 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:09,245 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741913_1089 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:33:09,245 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:33:09,245 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:33:09,245 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741916_1092 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444
2015-03-13 10:33:09,245 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741922_1098 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454
2015-03-13 10:33:09,245 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741917_1093 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:33:09,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008 dst=null perm=null
2015-03-13 10:33:09,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,287 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary
2015-03-13 10:33:09,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary dst=null perm=null
2015-03-13 10:33:09,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,288 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary
2015-03-13 10:33:09,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:09,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:09,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,291 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary
2015-03-13 10:33:09,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary dst=null perm=null
2015-03-13 10:33:09,298 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,299 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:09,299 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:09,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,302 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:09,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000 dst=null perm=null
2015-03-13 10:33:09,310 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,311 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:09,311 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:09,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,315 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:33:09,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:33:09,319 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53133, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 168000
2015-03-13 10:33:09,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:33:09,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 190000
2015-03-13 10:33:09,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:33:09,323 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 168000
2015-03-13 10:33:09,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:09,326 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53135, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 171000
2015-03-13 10:33:09,326 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/seq/tap
2015-03-13 10:33:09,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap dst=null perm=null
2015-03-13 10:33:09,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000 dst=null perm=null
2015-03-13 10:33:09,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000 dst=null perm=null
2015-03-13 10:33:09,330 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/seq/trap
2015-03-13 10:33:09,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap dst=null perm=null
2015-03-13 10:33:09,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:33:09,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:33:09,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53136, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 188000
2015-03-13 10:33:09,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:33:09,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:33:09,338 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53136, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 179000
2015-03-13 10:33:09,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:33:09,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:33:09,341 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53135, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 167000
2015-03-13 10:33:09,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:09,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:09,343 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53135, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 161000
2015-03-13 10:33:09,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:09,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:09,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,347 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt. BP-1641873285-10.1.1.144-1426267833098 blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:09,348 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102 src: /127.0.0.1:53137 dest: /127.0.0.1:52454
2015-03-13 10:33:09,350 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102 src: /127.0.0.1:53138 dest: /127.0.0.1:52444
2015-03-13 10:33:09,351 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102 src: /127.0.0.1:53139 dest: /127.0.0.1:52447
2015-03-13 10:33:09,353 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53139, dest: /127.0.0.1:52447, bytes: 5, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 1103000
2015-03-13 10:33:09,353 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,353 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:09,354 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53138, dest: /127.0.0.1:52444, bytes: 5, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 1484000
2015-03-13 10:33:09,354 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,354 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:09,354 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53137, dest: /127.0.0.1:52454, bytes: 5, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 2146000
2015-03-13 10:33:09,354 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:09,356 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,368 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,370 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:33:09,371 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:33:09,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:09,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:09,384 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [] starting
2015-03-13 10:33:09,384 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [] source: Hfs["TextDelimited[['id', 'name' | int, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt"]
2015-03-13 10:33:09,384 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [] sink: Hfs["TextDelimited[['id', 'name' | int, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation"]
2015-03-13 10:33:09,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [] parallel execution is enabled: true
2015-03-13 10:33:09,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [] starting jobs: 1
2015-03-13 10:33:09,385 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [] allocating threads: 1
2015-03-13 10:33:09,386 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] starting step: (1/1) ...tform/testTrapNoOperation
2015-03-13 10:33:09,395 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:09,403 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:09,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:09,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:09,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:09,408 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 9
2015-03-13 10:33:09,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009 dst=null perm=null
2015-03-13 10:33:09,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:33:09,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:33:09,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:09,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,415 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:09,416 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53141 dest: /127.0.0.1:52447
2015-03-13 10:33:09,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53142 dest: /127.0.0.1:52451
2015-03-13 10:33:09,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53143 dest: /127.0.0.1:52444
2015-03-13 10:33:09,423 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53143, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 1936000
2015-03-13 10:33:09,423 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,424 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53142, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 2565000
2015-03-13 10:33:09,424 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,425 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53141, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 3690000
2015-03-13 10:33:09,425 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,426 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,427 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,428 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar
2015-03-13 10:33:09,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:09,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:09,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:09,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:09,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:33:09,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:33:09,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:33:09,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:33:09,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:33:09,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:09,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:09,439 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:09,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:09,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,443 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split
2015-03-13 10:33:09,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:09,444 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:09,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53144 dest: /127.0.0.1:52454
2015-03-13 10:33:09,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53145 dest: /127.0.0.1:52451
2015-03-13 10:33:09,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53146 dest: /127.0.0.1:52447
2015-03-13 10:33:09,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53147 dest: /127.0.0.1:52444
2015-03-13 10:33:09,451 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53147, dest: /127.0.0.1:52444, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 1464000
2015-03-13 10:33:09,451 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,452 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,452 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53146, dest: /127.0.0.1:52447, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 1812000
2015-03-13 10:33:09,452 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,453 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,453 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53145, dest: /127.0.0.1:52451, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 2733000
2015-03-13 10:33:09,453 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,453 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,453 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53144, dest: /127.0.0.1:52454, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 3261000
2015-03-13 10:33:09,454 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,454 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,456 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,460 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:09,461 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105 src: /127.0.0.1:53148 dest: /127.0.0.1:52444
2015-03-13 10:33:09,462 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105 src: /127.0.0.1:53149 dest: /127.0.0.1:52447
2015-03-13 10:33:09,464 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105 src: /127.0.0.1:53150 dest: /127.0.0.1:52451
2015-03-13 10:33:09,466 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53150, dest: /127.0.0.1:52451, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 1162000
2015-03-13 10:33:09,466 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,467 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:09,467 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53149, dest: /127.0.0.1:52447, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 1695000
2015-03-13 10:33:09,467 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,468 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:09,468 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53148, dest: /127.0.0.1:52444, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 2914000
2015-03-13 10:33:09,468 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,470 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:09,471 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,471 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:33:09,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,476 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,477 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:09,477 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:09,507 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:09,508 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106 src: /127.0.0.1:53151 dest: /127.0.0.1:52444
2015-03-13 10:33:09,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106 src: /127.0.0.1:53152 dest: /127.0.0.1:52447
2015-03-13 10:33:09,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106 src: /127.0.0.1:53153 dest: /127.0.0.1:52454
2015-03-13 10:33:09,514 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53153, dest: /127.0.0.1:52454, bytes: 96639, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 1397000
2015-03-13 10:33:09,514 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,515 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:09,515 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53152, dest: /127.0.0.1:52447, bytes: 96639, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 2046000
2015-03-13 10:33:09,515 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,515 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:09,516 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53151, dest: /127.0.0.1:52444, bytes: 96639, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 2955000
2015-03-13 10:33:09,516 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:09,522 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,522 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0009
2015-03-13 10:33:09,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009 dst=null perm=null
2015-03-13 10:33:09,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:09,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:09,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:09,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:09,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:09,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:09,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:09,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:09,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:09,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:09,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:09,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:09,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:09,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:09,538 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 9 submitted by user soberoi
2015-03-13 10:33:09,538 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0009
2015-03-13 10:33:09,538 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0009
2015-03-13 10:33:09,538 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0009
2015-03-13 10:33:09,538 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from NEW to NEW_SAVING
2015-03-13 10:33:09,539 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:33:09,539 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0009_000001
2015-03-13 10:33:09,539 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from NEW to SUBMITTED
2015-03-13 10:33:09,539 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0009 from user: soberoi activated in queue: default
2015-03-13 10:33:09,539 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0009 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:33:09,539 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0009 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:33:09,539 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0009 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:09,539 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0009_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:33:09,540 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:33:09,541 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from SUBMITTED to ACCEPTED
2015-03-13 10:33:09,542 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0009/
2015-03-13 10:33:09,542 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] submitted hadoop job: job_1426267835672_0009
2015-03-13 10:33:09,542 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0009/
2015-03-13 10:33:10,001 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741927_1103 to datanode(s) 127.0.0.1:52454
2015-03-13 10:33:10,001 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741913_1089, blk_1073741914_1090]
2015-03-13 10:33:10,001 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741922_1098, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-03-13 10:33:10,107 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:10,108 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:10,109 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:10,109 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:33:10,109 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0009_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:10,109 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:33:10,109 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:10,110 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:10,110 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0009 AttemptId: appattempt_1426267835672_0009_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:33:10,111 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:33:10,111 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0009_000001
2015-03-13 10:33:10,111 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:33:10,111 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0009_000001
2015-03-13 10:33:10,112 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0009_000001
2015-03-13 10:33:10,112 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:33:10,117 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:10,121 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000001 by user soberoi
2015-03-13 10:33:10,121 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0009
2015-03-13 10:33:10,121 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:10,121 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from NEW to INITING
2015-03-13 10:33:10,121 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000001 to application application_1426267835672_0009
2015-03-13 10:33:10,121 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0009_000001
2015-03-13 10:33:10,122 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from INITING to RUNNING
2015-03-13 10:33:10,122 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:33:10,122 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:33:10,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:10,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,123 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000001
2015-03-13 10:33:10,131 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0009_01_000001.tokens. Credentials list:
2015-03-13 10:33:10,147 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:10,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001.tokens
2015-03-13 10:33:10,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:10,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:10,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:10,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:10,297 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 498000
2015-03-13 10:33:10,317 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:10,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:10,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:10,343 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 199000
2015-03-13 10:33:10,355 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:10,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:10,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:10,379 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 1883, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 179000
2015-03-13 10:33:10,392 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:10,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:10,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:10,418 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53157, bytes: 97395, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 222000
2015-03-13 10:33:10,431 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,431 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:10,456 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:10,456 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:10,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001/default_container_executor.sh]
2015-03-13 10:33:10,634 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:10,634 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:10,634 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 to 127.0.0.1:52454
2015-03-13 10:33:10,634 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:10,635 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:10,636 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53158 dest: /127.0.0.1:52454
2015-03-13 10:33:10,636 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:33:10,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53158 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:33:10,638 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741927_1103 size 254067
2015-03-13 10:33:11,014 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922 for deletion
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915 for deletion
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916 for deletion
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917 for deletion
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:11,015 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:11,016 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916
2015-03-13 10:33:11,016 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915
2015-03-13 10:33:11,016 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917
2015-03-13 10:33:11,032 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,033 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106
2015-03-13 10:33:11,034 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101
2015-03-13 10:33:11,034 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102
2015-03-13 10:33:11,047 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,048 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,048 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102
2015-03-13 10:33:11,049 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099
2015-03-13 10:33:11,049 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100
2015-03-13 10:33:11,050 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105
2015-03-13 10:33:11,051 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106
2015-03-13 10:33:11,113 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:11,114 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:11,114 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:11,237 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098
2015-03-13 10:33:11,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100
2015-03-13 10:33:11,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106
2015-03-13 10:33:11,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105
2015-03-13 10:33:11,497 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,498 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,499 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100
2015-03-13 10:33:11,499 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105
2015-03-13 10:33:11,500 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099
2015-03-13 10:33:11,500 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098
2015-03-13 10:33:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101
2015-03-13 10:33:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099
2015-03-13 10:33:11,669 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,692 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101
2015-03-13 10:33:11,868 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,869 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102
2015-03-13 10:33:12,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:12,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:12,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:12,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_STARTED dst=null perm=null
2015-03-13 10:33:12,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:33:12,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_FAIL dst=null perm=null
2015-03-13 10:33:12,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009 dst=null perm=null
2015-03-13 10:33:12,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:33:12,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:33:12,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:12,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:12,559 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53160, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 162000
2015-03-13 10:33:13,007 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741922_1098, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-03-13 10:33:13,007 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741922_1098, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-03-13 10:33:13,121 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:13,121 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:13,323 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:13,324 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0009_000001
2015-03-13 10:33:13,324 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0009 APPATTEMPTID=appattempt_1426267835672_0009_000001
2015-03-13 10:33:13,324 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:33:13,324 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from ACCEPTED to RUNNING
2015-03-13 10:33:13,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:13,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:13,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:13,551 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:13,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107 src: /127.0.0.1:53166 dest: /127.0.0.1:52444
2015-03-13 10:33:13,589 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107 src: /127.0.0.1:53167 dest: /127.0.0.1:52447
2015-03-13 10:33:13,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107 src: /127.0.0.1:53168 dest: /127.0.0.1:52454
2015-03-13 10:33:13,598 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53168, dest: /127.0.0.1:52454, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 5695000
2015-03-13 10:33:13,598 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:13,598 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:13,599 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53167, dest: /127.0.0.1:52447, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 6398000
2015-03-13 10:33:13,599 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:13,599 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:13,599 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53166, dest: /127.0.0.1:52444, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 7299000
2015-03-13 10:33:13,600 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:13,600 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:13,603 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922 for deletion
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915 for deletion
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916 for deletion
2015-03-13 10:33:13,639 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:13,640 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915
2015-03-13 10:33:13,640 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917 for deletion
2015-03-13 10:33:13,640 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916
2015-03-13 10:33:13,640 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917
2015-03-13 10:33:13,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922 for deletion
2015-03-13 10:33:13,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:13,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915 for deletion
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916 for deletion
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917 for deletion
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917
2015-03-13 10:33:13,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916
2015-03-13 10:33:14,122 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:14,122 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:14,381 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0008_01_000001 succeeded
2015-03-13 10:33:14,381 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:33:14,381 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000001
2015-03-13 10:33:14,388 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:33:14,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000001 from application application_1426267835672_0008
2015-03-13 10:33:14,390 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:14,390 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:15,124 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:33:15,124 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000001
2015-03-13 10:33:15,124 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:15,125 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:15,125 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:33:15,125 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0008_000001
2015-03-13 10:33:15,125 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0008 CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:33:15,125 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from FINISHING to FINISHED
2015-03-13 10:33:15,125 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:15,125 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from FINISHING to FINISHED
2015-03-13 10:33:15,126 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:15,126 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0008_000001
2015-03-13 10:33:15,126 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,126 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0008
2015-03-13 10:33:15,126 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,126 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0008,name=[F9B537FAC95645ECA39BE2CD77067409/E03532BB4F26472AB8B07F9C2D7BA44F] trap test/(1/1) ...-mr1/trapplatform/seq/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0008/jobhistory/job/job_1426267835672_0008,appMasterHost=Edinburgh.local,startTime=1426267969680,finishTime=1426267988239,finalStatus=SUCCEEDED
2015-03-13 10:33:15,126 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:33:15,126 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000001 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:15,127 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,127 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:15,127 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:33:15,127 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0009_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,127 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:33:15,128 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,128 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,128 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:15,128 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:33:15,129 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0009_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,129 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:33:15,129 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,129 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0008_000001 is done. finalState=FINISHED
2015-03-13 10:33:15,129 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:33:15,129 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0008 requests cleared
2015-03-13 10:33:15,129 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0008 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:33:15,129 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0008 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:33:15,131 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000001
2015-03-13 10:33:15,297 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,298 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:15,298 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:15,298 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0009_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,298 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:15,298 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,299 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:15,299 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:33:15,299 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0009_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,300 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:33:15,300 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,300 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,300 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:15,300 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:33:15,300 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0009_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,300 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:33:15,300 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,340 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:15,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,340 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0008
2015-03-13 10:33:15,341 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,341 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:15,341 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0008, with delay of 10800 seconds
2015-03-13 10:33:15,341 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,342 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,359 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:15,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:15,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:15,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:15,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:15,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:15,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:15,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:15,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:15,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:15,493 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:15,493 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:15,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000002 by user soberoi
2015-03-13 10:33:15,496 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000003 by user soberoi
2015-03-13 10:33:15,497 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000004 by user soberoi
2015-03-13 10:33:15,497 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000005 by user soberoi
2015-03-13 10:33:15,497 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0009
2015-03-13 10:33:15,497 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000006 by user soberoi
2015-03-13 10:33:15,497 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000005 to application application_1426267835672_0009
2015-03-13 10:33:15,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:15,496 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:15,497 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from NEW to INITING
2015-03-13 10:33:15,497 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000004 to application application_1426267835672_0009
2015-03-13 10:33:15,498 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000006 to application application_1426267835672_0009
2015-03-13 10:33:15,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:15,498 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from INITING to RUNNING
2015-03-13 10:33:15,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:15,498 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,498 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,497 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000002 to application application_1426267835672_0009
2015-03-13 10:33:15,499 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,499 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,499 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,499 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:15,499 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:15,499 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:15,500 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,499 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000003 to application application_1426267835672_0009
2015-03-13 10:33:15,500 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,500 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,500 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,500 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,500 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000006
2015-03-13 10:33:15,500 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,501 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000005
2015-03-13 10:33:15,501 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,501 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,502 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,502 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,502 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,502 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,503 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,506 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000004
2015-03-13 10:33:15,525 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0009_01_000005.tokens. Credentials list:
2015-03-13 10:33:15,525 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0009_01_000004.tokens. Credentials list:
2015-03-13 10:33:15,526 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0009_01_000006.tokens. Credentials list:
2015-03-13 10:33:15,544 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,545 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,545 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,545 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,550 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:15,644 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002/default_container_executor.sh]
2015-03-13 10:33:15,648 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003/default_container_executor.sh]
2015-03-13 10:33:15,649 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005.tokens
2015-03-13 10:33:15,649 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:15,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:15,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:15,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar dst=null perm=null
2015-03-13 10:33:15,753 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53174, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-82095608_4693, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 450000
2015-03-13 10:33:15,780 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:15,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:15,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:15,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml dst=null perm=null
2015-03-13 10:33:15,813 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53174, bytes: 97395, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-82095608_4693, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 296000
2015-03-13 10:33:15,832 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:15,832 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,832 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,833 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,893 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,893 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,893 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,893 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,893 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,893 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:16,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004/default_container_executor.sh]
2015-03-13 10:33:16,015 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005/default_container_executor.sh]
2015-03-13 10:33:16,031 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006/default_container_executor.sh]
2015-03-13 10:33:16,061 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107
2015-03-13 10:33:16,129 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,129 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,129 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,130 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:16,130 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,130 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,131 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0008
2015-03-13 10:33:16,131 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:16,131 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0008, with delay of 10800 seconds
2015-03-13 10:33:16,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107
2015-03-13 10:33:16,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,378 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:33:16,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:16,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107
2015-03-13 10:33:16,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0009_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006.tokens
2015-03-13 10:33:16,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:17,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:17,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,135 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004.tokens
2015-03-13 10:33:17,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:17,301 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,301 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,302 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,141 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,312 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,148 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,149 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,149 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,318 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,318 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,319 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,158 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:23,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:23,521 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53184, bytes: 1883, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000001_0_-1634886875_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 205000
2015-03-13 10:33:23,649 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53185, bytes: 1883, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 148000
2015-03-13 10:33:23,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:23,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:23,731 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53187, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000001_0_-1634886875_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 165000
2015-03-13 10:33:23,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:23,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:23,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split dst=null perm=null
2015-03-13 10:33:23,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:23,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53190, bytes: 1367, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000002_0_605197829_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 185000
2015-03-13 10:33:23,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:23,919 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53191, bytes: 851, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000004_0_-1928763944_1, offset: 1024, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 149000
2015-03-13 10:33:23,957 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53192, bytes: 851, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 161000
2015-03-13 10:33:23,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:23,994 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53190, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000002_0_605197829_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 160000
2015-03-13 10:33:24,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,051 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_1426267835672_0009_m_000001_0_-1634886875_1
2015-03-13 10:33:24,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:24,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0 dst=null perm=null
2015-03-13 10:33:24,063 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53193, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000004_0_-1928763944_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 155000
2015-03-13 10:33:24,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0 dst=null perm=null
2015-03-13 10:33:24,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001 dst=null perm=null
2015-03-13 10:33:24,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt dst=null perm=null
2015-03-13 10:33:24,091 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53192, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 166000
2015-03-13 10:33:24,098 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000003
2015-03-13 10:33:24,098 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:24,098 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,099 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000003
2015-03-13 10:33:24,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,111 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000003 is : 143
2015-03-13 10:33:24,113 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:24,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108 src: /127.0.0.1:53194 dest: /127.0.0.1:52451
2015-03-13 10:33:24,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108 src: /127.0.0.1:53195 dest: /127.0.0.1:52444
2015-03-13 10:33:24,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108 src: /127.0.0.1:53196 dest: /127.0.0.1:52447
2015-03-13 10:33:24,125 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist for DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,126 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,127 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,127 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,127 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,127 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:24,128 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,128 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,128 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000003 from application application_1426267835672_0009
2015-03-13 10:33:24,128 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,128 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,152 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53197, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 3739000
2015-03-13 10:33:24,186 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:24,232 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109 src: /127.0.0.1:53198 dest: /127.0.0.1:52447
2015-03-13 10:33:24,234 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109 src: /127.0.0.1:53199 dest: /127.0.0.1:52454
2015-03-13 10:33:24,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109 src: /127.0.0.1:53200 dest: /127.0.0.1:52451
2015-03-13 10:33:24,244 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53200, dest: /127.0.0.1:52451, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 6095000
2015-03-13 10:33:24,244 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,244 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,245 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53199, dest: /127.0.0.1:52454, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 6779000
2015-03-13 10:33:24,245 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,246 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53198, dest: /127.0.0.1:52447, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 8425000
2015-03-13 10:33:24,246 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,246 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,247 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,251 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1
2015-03-13 10:33:24,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0 dst=null perm=null
2015-03-13 10:33:24,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0 dst=null perm=null
2015-03-13 10:33:24,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000 dst=null perm=null
2015-03-13 10:33:24,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,289 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000002
2015-03-13 10:33:24,289 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:24,289 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,289 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000002
2015-03-13 10:33:24,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,290 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,290 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:24,290 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000003
2015-03-13 10:33:24,290 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:24,291 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:24,291 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:24,291 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:33:24,291 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:33:24,291 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,292 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,292 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:33:24,292 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000003 on node: host: 10.1.1.144:52481 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:24,302 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000002 is : 143
2015-03-13 10:33:24,315 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,317 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:24,317 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,317 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000002 from application application_1426267835672_0009
2015-03-13 10:33:24,318 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,318 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,381 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_1426267835672_0009_m_000002_0_605197829_1
2015-03-13 10:33:24,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0 dst=null perm=null
2015-03-13 10:33:24,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0 dst=null perm=null
2015-03-13 10:33:24,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002 dst=null perm=null
2015-03-13 10:33:24,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,420 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0/part-00004 is closed by DFSClient_attempt_1426267835672_0009_m_000004_0_-1928763944_1
2015-03-13 10:33:24,425 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000004
2015-03-13 10:33:24,425 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:24,425 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,425 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000004
2015-03-13 10:33:24,425 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,426 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,426 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,439 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000004 is : 143
2015-03-13 10:33:24,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0 dst=null perm=null
2015-03-13 10:33:24,450 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,451 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,452 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000004 from application application_1426267835672_0009
2015-03-13 10:33:24,452 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,452 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0 dst=null perm=null
2015-03-13 10:33:24,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004 dst=null perm=null
2015-03-13 10:33:24,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary dst=null perm=null
2015-03-13 10:33:24,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,471 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000006
2015-03-13 10:33:24,471 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:24,471 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,471 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000006
2015-03-13 10:33:24,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:24,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000004
2015-03-13 10:33:24,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,473 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:24,473 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:24,473 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:24,473 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:33:24,473 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:24,474 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,474 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,474 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:24,474 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000004 on node: host: 10.1.1.144:52477 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:24,483 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000006 is : 143
2015-03-13 10:33:24,493 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:24,494 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,494 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:24,497 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,497 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000006 from application application_1426267835672_0009
2015-03-13 10:33:24,497 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,530 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110 src: /127.0.0.1:53201 dest: /127.0.0.1:52451
2015-03-13 10:33:24,532 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110 src: /127.0.0.1:53202 dest: /127.0.0.1:52454
2015-03-13 10:33:24,533 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110 src: /127.0.0.1:53203 dest: /127.0.0.1:52444
2015-03-13 10:33:24,541 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53203, dest: /127.0.0.1:52444, bytes: 2, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 6229000
2015-03-13 10:33:24,541 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,541 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:24,541 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53202, dest: /127.0.0.1:52454, bytes: 2, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 6855000
2015-03-13 10:33:24,542 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,542 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:24,542 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53201, dest: /127.0.0.1:52451, bytes: 2, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 7857000
2015-03-13 10:33:24,543 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,543 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:24,547 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1
2015-03-13 10:33:24,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:24,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,583 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1
2015-03-13 10:33:24,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0 dst=null perm=null
2015-03-13 10:33:24,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003 dst=null perm=null
2015-03-13 10:33:24,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,606 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000005
2015-03-13 10:33:24,606 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:24,606 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,606 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000005
2015-03-13 10:33:24,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:24,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000006
2015-03-13 10:33:24,607 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:24,608 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:33:24,608 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:24,608 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:24,608 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:24,609 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,609 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,609 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:24,609 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000006 on node: host: 10.1.1.144:52477 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:24,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,613 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1 dst=null perm=null
2015-03-13 10:33:24,618 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000005 is : 143
2015-03-13 10:33:24,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000 dst=null perm=null
2015-03-13 10:33:24,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000 dst=null perm=null
2015-03-13 10:33:24,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,632 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,632 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,632 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,633 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:24,633 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,633 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000005 from application application_1426267835672_0009
2015-03-13 10:33:24,633 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,633 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001 dst=null perm=null
2015-03-13 10:33:24,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001 dst=null perm=null
2015-03-13 10:33:24,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002 dst=null perm=null
2015-03-13 10:33:24,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002 dst=null perm=null
2015-03-13 10:33:24,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003 dst=null perm=null
2015-03-13 10:33:24,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003 dst=null perm=null
2015-03-13 10:33:24,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:24,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004 dst=null perm=null
2015-03-13 10:33:24,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004 dst=null perm=null
2015-03-13 10:33:24,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary dst=null perm=null
2015-03-13 10:33:24,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,673 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,677 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,691 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53196, dest: /127.0.0.1:52447, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 571310000
2015-03-13 10:33:24,691 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,693 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53195, dest: /127.0.0.1:52444, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 572069000
2015-03-13 10:33:24,693 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,695 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,695 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53194, dest: /127.0.0.1:52451, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 574234000
2015-03-13 10:33:24,695 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,697 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,701 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,709 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:24,711 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111 src: /127.0.0.1:53204 dest: /127.0.0.1:52454
2015-03-13 10:33:24,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111 src: /127.0.0.1:53205 dest: /127.0.0.1:52447
2015-03-13 10:33:24,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111 src: /127.0.0.1:53206 dest: /127.0.0.1:52451
2015-03-13 10:33:24,718 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53206, dest: /127.0.0.1:52451, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 2534000
2015-03-13 10:33:24,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,719 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53205, dest: /127.0.0.1:52447, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 3270000
2015-03-13 10:33:24,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,720 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,720 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53204, dest: /127.0.0.1:52454, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 4135000
2015-03-13 10:33:24,720 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,721 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,722 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist dst=null perm=null
2015-03-13 10:33:24,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:33:24,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist dst=null perm=null
2015-03-13 10:33:24,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:33:24,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist dst=null perm=null
2015-03-13 10:33:24,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53207, bytes: 51839, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 202000
2015-03-13 10:33:24,746 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:24,748 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112 src: /127.0.0.1:53208 dest: /127.0.0.1:52451
2015-03-13 10:33:24,749 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112 src: /127.0.0.1:53209 dest: /127.0.0.1:52447
2015-03-13 10:33:24,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112 src: /127.0.0.1:53210 dest: /127.0.0.1:52454
2015-03-13 10:33:24,753 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53210, dest: /127.0.0.1:52454, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, duration: 1420000
2015-03-13 10:33:24,753 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,754 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:24,754 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53209, dest: /127.0.0.1:52447, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, duration: 1882000
2015-03-13 10:33:24,754 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,754 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:24,755 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53208, dest: /127.0.0.1:52451, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, duration: 2787000
2015-03-13 10:33:24,755 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,755 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:24,757 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml dst=null perm=null
2015-03-13 10:33:24,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp dst=null perm=null
2015-03-13 10:33:24,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml dst=null perm=null
2015-03-13 10:33:24,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp dst=null perm=null
2015-03-13 10:33:24,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml dst=null perm=null
2015-03-13 10:33:24,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,767 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53207, bytes: 90119, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 323000
2015-03-13 10:33:24,769 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:24,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113 src: /127.0.0.1:53211 dest: /127.0.0.1:52454
2015-03-13 10:33:24,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113 src: /127.0.0.1:53212 dest: /127.0.0.1:52444
2015-03-13 10:33:24,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113 src: /127.0.0.1:53213 dest: /127.0.0.1:52447
2015-03-13 10:33:24,778 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53213, dest: /127.0.0.1:52447, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, duration: 2069000
2015-03-13 10:33:24,778 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,778 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,778 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53212, dest: /127.0.0.1:52444, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, duration: 2794000
2015-03-13 10:33:24,779 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,779 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,779 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53211, dest: /127.0.0.1:52454, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, duration: 3539000
2015-03-13 10:33:24,779 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,780 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,781 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,795 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from RUNNING to FINISHING
2015-03-13 10:33:24,795 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0009
2015-03-13 10:33:24,796 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from RUNNING to REMOVING
2015-03-13 10:33:24,796 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0009
2015-03-13 10:33:24,796 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from REMOVING to FINISHING
2015-03-13 10:33:25,296 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:25,296 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:25,296 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000002
2015-03-13 10:33:25,297 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:25,297 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:25,297 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:25,297 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:25,298 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:25,298 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,299 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,299 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:25,299 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000002 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:25,613 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:25,613 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000005
2015-03-13 10:33:25,614 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:25,614 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:25,614 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:25,614 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:25,614 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:25,615 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,615 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,615 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:25,615 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000005 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:25,806 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741927_1103 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:33:25,806 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741928_1104 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:33:25,807 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741929_1105 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:33:25,807 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741930_1106 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:33:25,807 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741932_1108 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:33:25,807 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741931_1107 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:33:25,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009 dst=null perm=null
2015-03-13 10:33:25,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:25,844 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary
2015-03-13 10:33:25,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary dst=null perm=null
2015-03-13 10:33:25,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,845 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary
2015-03-13 10:33:25,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary dst=null perm=null
2015-03-13 10:33:25,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary dst=null perm=null
2015-03-13 10:33:25,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:25,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:25,855 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:25,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,859 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:25,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:25,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53215, bytes: 6, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 175000
2015-03-13 10:33:25,862 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/testTrapNoOperation_trap
2015-03-13 10:33:25,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap dst=null perm=null
2015-03-13 10:33:25,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:25,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:33:25,867 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 6, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 183000
2015-03-13 10:33:25,867 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/testTrapNoOperation
2015-03-13 10:33:25,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:25,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:25,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:25,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation dst=null perm=null
2015-03-13 10:33:25,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000 dst=null perm=null
2015-03-13 10:33:25,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000 dst=null perm=null
2015-03-13 10:33:25,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 138000
2015-03-13 10:33:25,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001 dst=null perm=null
2015-03-13 10:33:25,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001 dst=null perm=null
2015-03-13 10:33:25,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002 dst=null perm=null
2015-03-13 10:33:25,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002 dst=null perm=null
2015-03-13 10:33:25,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003 dst=null perm=null
2015-03-13 10:33:25,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003 dst=null perm=null
2015-03-13 10:33:25,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004 dst=null perm=null
2015-03-13 10:33:25,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004 dst=null perm=null
2015-03-13 10:33:25,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:25,891 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:25,892 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:33:25,893 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:33:25,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:25,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:25,904 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:33:25,904 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:33:25,904 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap"]
2015-03-13 10:33:25,905 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:33:25,905 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:33:25,905 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:33:25,906 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...applatform/everystart/tap
2015-03-13 10:33:25,923 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:25,933 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:25,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:25,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:25,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:25,938 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 10
2015-03-13 10:33:25,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010 dst=null perm=null
2015-03-13 10:33:25,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:33:25,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:33:25,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:25,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,944 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:25,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53218 dest: /127.0.0.1:52447
2015-03-13 10:33:25,947 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53219 dest: /127.0.0.1:52444
2015-03-13 10:33:25,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53220 dest: /127.0.0.1:52454
2015-03-13 10:33:25,952 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53220, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 2192000
2015-03-13 10:33:25,952 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:25,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:25,952 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53219, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 2559000
2015-03-13 10:33:25,953 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:25,953 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53218, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 3843000
2015-03-13 10:33:25,953 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,954 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:25,955 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:25,956 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar
2015-03-13 10:33:25,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:25,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:25,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:25,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:25,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:33:25,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:33:25,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:33:25,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:33:25,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:33:25,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:25,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:25,964 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:25,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:25,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,970 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split
2015-03-13 10:33:25,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:25,971 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:25,973 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53221 dest: /127.0.0.1:52451
2015-03-13 10:33:25,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53222 dest: /127.0.0.1:52454
2015-03-13 10:33:25,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53223 dest: /127.0.0.1:52447
2015-03-13 10:33:25,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53224 dest: /127.0.0.1:52444
2015-03-13 10:33:25,980 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53224, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 1532000
2015-03-13 10:33:25,980 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:25,980 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,980 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53223, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 2118000
2015-03-13 10:33:25,981 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,981 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,981 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53222, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 3010000
2015-03-13 10:33:25,981 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,982 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,982 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53221, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 3941000
2015-03-13 10:33:25,982 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,983 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,984 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:25,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,989 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:25,991 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116 src: /127.0.0.1:53225 dest: /127.0.0.1:52444
2015-03-13 10:33:25,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116 src: /127.0.0.1:53226 dest: /127.0.0.1:52454
2015-03-13 10:33:25,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116 src: /127.0.0.1:53227 dest: /127.0.0.1:52451
2015-03-13 10:33:25,995 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53227, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 1126000
2015-03-13 10:33:25,996 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:25,996 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:25,996 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53226, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 1540000
2015-03-13 10:33:25,996 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,997 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:25,997 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53225, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 2157000
2015-03-13 10:33:25,997 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,998 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:25,999 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:25,999 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:33:26,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:26,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:26,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:26,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:26,003 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:26,006 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:26,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117 src: /127.0.0.1:53228 dest: /127.0.0.1:52447
2015-03-13 10:33:26,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117 src: /127.0.0.1:53229 dest: /127.0.0.1:52451
2015-03-13 10:33:26,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117 src: /127.0.0.1:53230 dest: /127.0.0.1:52444
2015-03-13 10:33:26,012 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53230, dest: /127.0.0.1:52444, bytes: 98158, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 1493000
2015-03-13 10:33:26,013 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:26,013 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53229, dest: /127.0.0.1:52451, bytes: 98158, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 1897000
2015-03-13 10:33:26,013 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:26,013 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:26,014 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53228, dest: /127.0.0.1:52447, bytes: 98158, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 2702000
2015-03-13 10:33:26,014 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:26,014 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:26,015 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:26,016 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:26,016 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0010
2015-03-13 10:33:26,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010 dst=null perm=null
2015-03-13 10:33:26,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:26,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:26,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:26,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:26,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:26,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:26,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:26,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:26,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:26,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:26,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:26,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:26,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:26,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:26,032 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 10 submitted by user soberoi
2015-03-13 10:33:26,032 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0010
2015-03-13 10:33:26,032 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0010
2015-03-13 10:33:26,032 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0010
2015-03-13 10:33:26,032 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from NEW to NEW_SAVING
2015-03-13 10:33:26,032 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:33:26,033 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,033 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from NEW to SUBMITTED
2015-03-13 10:33:26,033 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0010 from user: soberoi activated in queue: default
2015-03-13 10:33:26,033 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0010 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:33:26,033 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0010 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:33:26,033 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0010 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:26,033 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0010_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:33:26,034 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:33:26,035 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from SUBMITTED to ACCEPTED
2015-03-13 10:33:26,036 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0010/
2015-03-13 10:33:26,036 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0010
2015-03-13 10:33:26,036 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0010/
2015-03-13 10:33:26,070 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113
2015-03-13 10:33:26,071 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108
2015-03-13 10:33:26,071 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111
2015-03-13 10:33:26,072 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112
2015-03-13 10:33:26,072 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109
2015-03-13 10:33:26,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117
2015-03-13 10:33:26,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:26,247 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110
2015-03-13 10:33:26,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113
2015-03-13 10:33:26,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112
2015-03-13 10:33:26,249 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111
2015-03-13 10:33:26,249 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:26,249 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116
2015-03-13 10:33:26,249 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109
2015-03-13 10:33:26,297 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:26,298 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:26,298 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:26,298 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:33:26,298 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0010_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:26,299 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:33:26,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:26,299 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:26,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0010 AttemptId: appattempt_1426267835672_0010_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:33:26,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:33:26,300 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,301 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:33:26,301 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0010_000001
2015-03-13 10:33:26,301 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,302 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0010_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:33:26,304 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:26,305 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000001 by user soberoi
2015-03-13 10:33:26,306 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0010
2015-03-13 10:33:26,306 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:26,306 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from NEW to INITING
2015-03-13 10:33:26,306 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000001 to application application_1426267835672_0010
2015-03-13 10:33:26,306 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from INITING to RUNNING
2015-03-13 10:33:26,306 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,306 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:33:26,306 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:33:26,306 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:26,307 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000001
2015-03-13 10:33:26,317 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0010_01_000001.tokens. Credentials list:
2015-03-13 10:33:26,334 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:26,407 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0010_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001.tokens
2015-03-13 10:33:26,407 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:26,450 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:26,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:26,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:26,471 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:26,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:26,479 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53234, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 484000
2015-03-13 10:33:26,498 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:26,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:26,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:26,522 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 189000
2015-03-13 10:33:26,535 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:26,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:26,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:26,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 177000
2015-03-13 10:33:26,571 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:26,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:26,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:26,595 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 98926, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 271000
2015-03-13 10:33:26,608 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,608 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:26,641 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:26,641 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:26,697 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108
2015-03-13 10:33:26,698 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111
2015-03-13 10:33:26,698 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116
2015-03-13 10:33:26,699 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112
2015-03-13 10:33:26,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117
2015-03-13 10:33:26,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:26,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110
2015-03-13 10:33:26,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109
2015-03-13 10:33:26,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001/default_container_executor.sh]
2015-03-13 10:33:26,884 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117
2015-03-13 10:33:26,884 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108
2015-03-13 10:33:26,885 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116
2015-03-13 10:33:26,885 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110
2015-03-13 10:33:26,886 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113
2015-03-13 10:33:26,886 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:27,088 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:27,301 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:27,302 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:27,302 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:28,017 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741938_1114 to datanode(s) 127.0.0.1:52451
2015-03-13 10:33:28,017 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741929_1105, blk_1073741932_1108]
2015-03-13 10:33:28,018 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741929_1105, blk_1073741930_1106, blk_1073741931_1107, blk_1073741932_1108]
2015-03-13 10:33:28,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:28,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:28,308 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:28,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_STARTED dst=null perm=null
2015-03-13 10:33:28,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:33:28,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_FAIL dst=null perm=null
2015-03-13 10:33:28,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010 dst=null perm=null
2015-03-13 10:33:28,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:33:28,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:33:28,645 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:28,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:28,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929 for deletion
2015-03-13 10:33:28,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930 for deletion
2015-03-13 10:33:28,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931 for deletion
2015-03-13 10:33:28,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932 for deletion
2015-03-13 10:33:28,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:28,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929
2015-03-13 10:33:28,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931
2015-03-13 10:33:28,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:28,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930
2015-03-13 10:33:28,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932
2015-03-13 10:33:28,648 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 to 127.0.0.1:52451
2015-03-13 10:33:28,650 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 (numBytes=254067) to /127.0.0.1:52451
2015-03-13 10:33:28,651 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53236 dest: /127.0.0.1:52451
2015-03-13 10:33:28,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53236 dest: /127.0.0.1:52451 of size 254067
2015-03-13 10:33:28,653 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741938_1114 size 254067
2015-03-13 10:33:28,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:28,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:28,725 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53237, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 148000
2015-03-13 10:33:28,894 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:28,894 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:28,894 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929 for deletion
2015-03-13 10:33:28,894 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932 for deletion
2015-03-13 10:33:28,895 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:28,895 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929
2015-03-13 10:33:28,895 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:28,895 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932
2015-03-13 10:33:29,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:29,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:29,517 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:29,519 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0010_000001
2015-03-13 10:33:29,519 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0010 APPATTEMPTID=appattempt_1426267835672_0010_000001
2015-03-13 10:33:29,519 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:33:29,519 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from ACCEPTED to RUNNING
2015-03-13 10:33:29,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:29,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:29,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:29,734 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:29,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118 src: /127.0.0.1:53243 dest: /127.0.0.1:52451
2015-03-13 10:33:29,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118 src: /127.0.0.1:53244 dest: /127.0.0.1:52444
2015-03-13 10:33:29,777 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118 src: /127.0.0.1:53245 dest: /127.0.0.1:52454
2015-03-13 10:33:29,786 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53245, dest: /127.0.0.1:52454, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 6939000
2015-03-13 10:33:29,786 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:29,787 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53244, dest: /127.0.0.1:52444, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 7791000
2015-03-13 10:33:29,787 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:29,787 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:29,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:29,788 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53243, dest: /127.0.0.1:52451, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 9037000
2015-03-13 10:33:29,789 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:29,789 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:29,794 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:30,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:30,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:30,629 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,629 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:30,629 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:30,630 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,630 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:33:30,630 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,631 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,631 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:30,631 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:33:30,631 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,631 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:33:30,632 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,632 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,632 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:30,632 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:33:30,633 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,633 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:33:30,633 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,633 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:30,633 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:33:30,633 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,634 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:33:30,634 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,942 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0009_01_000001 succeeded
2015-03-13 10:33:30,942 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:33:30,942 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000001
2015-03-13 10:33:30,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:33:30,951 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000001 from application application_1426267835672_0009
2015-03-13 10:33:30,952 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:30,952 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:31,020 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741930_1106, blk_1073741931_1107]
2015-03-13 10:33:31,021 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741929_1105, blk_1073741930_1106, blk_1073741931_1107, blk_1073741932_1108]
2015-03-13 10:33:31,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:33:31,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000001
2015-03-13 10:33:31,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:31,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:31,317 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0009_000001
2015-03-13 10:33:31,317 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:33:31,318 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from FINISHING to FINISHED
2015-03-13 10:33:31,318 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0009 CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:31,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from FINISHING to FINISHED
2015-03-13 10:33:31,318 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:31,318 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0009_000001
2015-03-13 10:33:31,318 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:33:31,318 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0009
2015-03-13 10:33:31,319 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:31,319 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0009,name=[A48777BC2FF94C92AE93C35F857FE6CB/2BD2562F74F34B63B0815D5262A06CC5] null/(1/1) ...tform/testTrapNoOperation,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0009/jobhistory/job/job_1426267835672_0009,appMasterHost=Edinburgh.local,startTime=1426267989538,finishTime=1426268004796,finalStatus=SUCCEEDED
2015-03-13 10:33:31,319 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:31,319 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:33:31,319 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000001 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:31,319 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0009_000001 is done. finalState=FINISHED
2015-03-13 10:33:31,319 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0009 requests cleared
2015-03-13 10:33:31,319 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0009 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:33:31,320 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0009 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:33:31,321 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:31,323 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000001
2015-03-13 10:33:31,454 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118
2015-03-13 10:33:31,559 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,559 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,559 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,559 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:31,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:31,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:31,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:31,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:31,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:31,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:31,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:31,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:31,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:31,632 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:31,633 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0009
2015-03-13 10:33:31,633 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:31,633 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0009, with delay of 10800 seconds
2015-03-13 10:33:31,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:31,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:31,646 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929 for deletion
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930 for deletion
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931 for deletion
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932 for deletion
2015-03-13 10:33:31,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930
2015-03-13 10:33:31,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931
2015-03-13 10:33:31,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932
2015-03-13 10:33:31,684 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:31,686 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000005 by user soberoi
2015-03-13 10:33:31,687 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0010
2015-03-13 10:33:31,687 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:31,687 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000003 by user soberoi
2015-03-13 10:33:31,687 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000004 by user soberoi
2015-03-13 10:33:31,687 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:31,687 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from NEW to INITING
2015-03-13 10:33:31,688 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000005 to application application_1426267835672_0010
2015-03-13 10:33:31,688 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000003 to application application_1426267835672_0010
2015-03-13 10:33:31,688 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000004 to application application_1426267835672_0010
2015-03-13 10:33:31,687 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000002 by user soberoi
2015-03-13 10:33:31,688 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from INITING to RUNNING
2015-03-13 10:33:31,688 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:31,688 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,687 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:31,689 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,689 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,689 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000002 to application application_1426267835672_0010
2015-03-13 10:33:31,689 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,689 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,689 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,689 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,689 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:31,690 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:31,690 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,690 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,690 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,690 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,691 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,691 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000003
2015-03-13 10:33:31,691 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000004
2015-03-13 10:33:31,692 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000005
2015-03-13 10:33:31,695 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,695 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,695 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,695 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,695 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000002
2015-03-13 10:33:31,705 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118
2015-03-13 10:33:31,707 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:31,714 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000003.tokens. Credentials list:
2015-03-13 10:33:31,716 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0010_01_000005.tokens. Credentials list:
2015-03-13 10:33:31,717 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000002.tokens. Credentials list:
2015-03-13 10:33:31,720 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0010_01_000004.tokens. Credentials list:
2015-03-13 10:33:31,733 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:31,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003.tokens
2015-03-13 10:33:31,802 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:31,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:31,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:31,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar dst=null perm=null
2015-03-13 10:33:31,873 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53250, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1104594832_5096, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 381000
2015-03-13 10:33:31,893 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:31,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:31,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:31,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml dst=null perm=null
2015-03-13 10:33:31,917 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53251, bytes: 98926, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1104594832_5096, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 331000
2015-03-13 10:33:31,930 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:31,930 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,971 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,971 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:31,971 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,972 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:31,972 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,972 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:31,972 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,972 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:32,022 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:32,022 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:32,022 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930 for deletion
2015-03-13 10:33:32,023 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931 for deletion
2015-03-13 10:33:32,023 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:32,023 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930
2015-03-13 10:33:32,023 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:32,023 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931
2015-03-13 10:33:32,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004/default_container_executor.sh]
2015-03-13 10:33:32,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003/default_container_executor.sh]
2015-03-13 10:33:32,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005/default_container_executor.sh]
2015-03-13 10:33:32,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002/default_container_executor.sh]
2015-03-13 10:33:32,095 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118
2015-03-13 10:33:32,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,322 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:32,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,323 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0009
2015-03-13 10:33:32,323 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:32,323 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0009, with delay of 10800 seconds
2015-03-13 10:33:32,575 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:33:32,637 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,964 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:33,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0010_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004.tokens
2015-03-13 10:33:33,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:33,174 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:33,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002.tokens
2015-03-13 10:33:33,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:33,324 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,415 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:33,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0010_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005.tokens
2015-03-13 10:33:33,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:33,641 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,641 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,641 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,642 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,324 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,642 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,332 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:38,341 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:38,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:38,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53262, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000000_0_-515901384_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 172000
2015-03-13 10:33:38,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53263, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000002_0_331976681_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 150000
2015-03-13 10:33:38,513 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53264, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000001_0_-1823108156_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 161000
2015-03-13 10:33:38,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split dst=null perm=null
2015-03-13 10:33:38,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:38,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53262, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000000_0_-515901384_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 186000
2015-03-13 10:33:38,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:38,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:38,625 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53267, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000002_0_331976681_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 186000
2015-03-13 10:33:38,640 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53266, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000003_0_-1525903624_1, offset: 1024, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 148000
2015-03-13 10:33:38,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:38,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53268, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000003_0_-1525903624_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 157000
2015-03-13 10:33:38,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000000_0 dst=null perm=null
2015-03-13 10:33:38,988 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53269, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000001_0_-1823108156_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1062000
2015-03-13 10:33:39,015 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000002
2015-03-13 10:33:39,015 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:39,015 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,015 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000002
2015-03-13 10:33:39,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:39,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,027 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000002 is : 143
2015-03-13 10:33:39,032 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:39,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119 src: /127.0.0.1:53270 dest: /127.0.0.1:52454
2015-03-13 10:33:39,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119 src: /127.0.0.1:53271 dest: /127.0.0.1:52447
2015-03-13 10:33:39,038 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119 src: /127.0.0.1:53272 dest: /127.0.0.1:52451
2015-03-13 10:33:39,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000001_0 dst=null perm=null
2015-03-13 10:33:39,047 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,048 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:39,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,049 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,049 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,049 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000002 from application application_1426267835672_0010
2015-03-13 10:33:39,049 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,049 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,050 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist for DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:39,050 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 1038 Total time for transactions(ms): 71 Number of transactions batched in Syncs: 20 Number of syncs: 577 SyncTimes(ms): 156 100
2015-03-13 10:33:39,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000002_0 dst=null perm=null
2015-03-13 10:33:39,067 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000003
2015-03-13 10:33:39,068 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:39,068 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,068 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000003
2015-03-13 10:33:39,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000002
2015-03-13 10:33:39,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:39,069 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,069 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,069 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:39,069 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:39,069 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:39,070 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:33:39,070 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:39,070 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,070 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,070 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:39,070 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000002 on node: host: 10.1.1.144:52477 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:39,080 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000003 is : 143
2015-03-13 10:33:39,093 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,093 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000004
2015-03-13 10:33:39,093 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:39,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,094 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,094 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,096 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,097 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:39,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,097 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000004
2015-03-13 10:33:39,107 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000004 is : 143
2015-03-13 10:33:39,118 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000003 from application application_1426267835672_0010
2015-03-13 10:33:39,118 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,119 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,119 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,121 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:39,121 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,122 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000004 from application application_1426267835672_0010
2015-03-13 10:33:39,122 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000003_0 dst=null perm=null
2015-03-13 10:33:39,181 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000005
2015-03-13 10:33:39,181 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:39,181 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,182 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000005
2015-03-13 10:33:39,182 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,182 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000003
2015-03-13 10:33:39,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000004
2015-03-13 10:33:39,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:39,183 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:39,183 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:39,184 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:39,184 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:33:39,184 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:39,184 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,184 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,184 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:39,184 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000003 on node: host: 10.1.1.144:52477 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:39,184 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:39,184 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:39,185 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:39,185 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:39,185 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:39,185 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,185 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,185 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:39,185 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000004 on node: host: 10.1.1.144:52477 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:39,192 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000005 is : 143
2015-03-13 10:33:39,199 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,199 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,199 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,200 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000005 from application application_1426267835672_0010
2015-03-13 10:33:39,200 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,201 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:40,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:40,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000005
2015-03-13 10:33:40,190 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:40,190 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:40,190 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:40,190 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:40,190 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:40,190 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:40,191 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:40,191 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:40,191 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000005 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:40,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:41,192 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:41,192 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:41,192 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:41,192 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:41,193 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:41,193 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:41,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:41,609 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:41,617 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000006 by user soberoi
2015-03-13 10:33:41,617 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:41,617 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000006 to application application_1426267835672_0010
2015-03-13 10:33:41,618 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:33:41,618 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:41,618 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:41,618 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:41,618 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:41,619 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:41,644 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:41,645 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:41,723 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006/default_container_executor.sh]
2015-03-13 10:33:42,046 INFO hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:33:42,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:33:42,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:33:42,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary dst=null perm=null
2015-03-13 10:33:42,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary dst=null perm=null
2015-03-13 10:33:42,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary dst=null perm=null
2015-03-13 10:33:42,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53274, bytes: 428, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 484000
2015-03-13 10:33:42,060 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0001,submitTime=1426267844168,launchTime=1426267847629,firstMapTaskLaunchTime=1426267849787,firstReduceTaskLaunchTime=1426267860731,finishTime=1426267863543,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotSeconds=2,jobName=[61C1702FCC0A429FBD628FD813F0535B/26757E2D2BB340BFA59A7DCBA8B66383] trap test/(1/2)
2015-03-13 10:33:42,060 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary]
2015-03-13 10:33:42,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53275, bytes: 456, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 227000
2015-03-13 10:33:42,061 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0002,submitTime=1426267864937,launchTime=1426267868427,firstMapTaskLaunchTime=1426267870576,firstReduceTaskLaunchTime=1426267875504,finishTime=1426267878416,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=1,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=2,reduceSlotSeconds=2,jobName=[61C1702FCC0A429FBD628FD813F0535B/79C6C455F92F4DC7B488B1927023B72E] trap test/(2/2) ...atform/eacheverychain/tap
2015-03-13 10:33:42,063 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary]
2015-03-13 10:33:42,064 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53276, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 185000
2015-03-13 10:33:42,065 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:33:42,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary dst=null perm=null
2015-03-13 10:33:42,065 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0003,submitTime=1426267879845,launchTime=1426267883352,firstMapTaskLaunchTime=1426267885517,firstReduceTaskLaunchTime=1426267895452,finishTime=1426267898057,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=2,jobName=[A5DA9BA04876490E83B797AC0CE57F3F/1D775ED593824D6FA1483A7D4ADBD8AA] trap test/(1/1) ...atform/everyaggregate/tap
2015-03-13 10:33:42,065 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary]
2015-03-13 10:33:42,066 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:33:42,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary dst=null perm=null
2015-03-13 10:33:42,072 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52447
2015-03-13 10:33:42,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary dst=null perm=null
2015-03-13 10:33:42,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,076 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,076 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,077 INFO hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(885)) - Perms after creating 504, Expected: 504
2015-03-13 10:33:42,078 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,083 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003_conf.xml
2015-03-13 10:33:42,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,083 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002_conf.xml
2015-03-13 10:33:42,083 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001_conf.xml
2015-03-13 10:33:42,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary dst=null perm=null
2015-03-13 10:33:42,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary dst=null perm=null
2015-03-13 10:33:42,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary dst=null perm=null
2015-03-13 10:33:42,089 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53276, bytes: 456, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 165000
2015-03-13 10:33:42,089 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53275, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 152000
2015-03-13 10:33:42,090 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0005,submitTime=1426267919207,launchTime=1426267922646,firstMapTaskLaunchTime=1426267924787,firstReduceTaskLaunchTime=1426267930720,finishTime=1426267933389,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=1,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=3,reduceSlotSeconds=2,jobName=[AA7C1D7EA74C4401BE2D2CFBE5BCEEF1/5E7BEE4954DF42539615E4FD31314DC4] trap test/(1/1) ...tform/trapsourcesink/sink
2015-03-13 10:33:42,090 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53277, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 135000
2015-03-13 10:33:42,090 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0006,submitTime=1426267934765,launchTime=1426267938292,firstMapTaskLaunchTime=1426267940450,firstReduceTaskLaunchTime=1426267950380,finishTime=1426267953307,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotSeconds=2,jobName=[2E6720DC81AE485EA9AF60ED96CF5170/FD9C0A1F88154A1F92C3C9299F12FC78] trap test/(1/1) ...latform/everycomplete/tap
2015-03-13 10:33:42,090 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary]
2015-03-13 10:33:42,090 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary]
2015-03-13 10:33:42,090 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0004,submitTime=1426267899477,launchTime=1426267903236,firstMapTaskLaunchTime=1426267905398,firstReduceTaskLaunchTime=1426267915323,finishTime=1426267917806,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotSeconds=2,jobName=[556A3EF415294468966B68292BE360F8/1F24603F771643C9A3DB4171C3FE2709] trap test/(1/1) ...-mr1/trapplatform/all/tap
2015-03-13 10:33:42,091 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary]
2015-03-13 10:33:42,092 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:33:42,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary dst=null perm=null
2015-03-13 10:33:42,092 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:33:42,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary dst=null perm=null
2015-03-13 10:33:42,092 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:33:42,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary dst=null perm=null
2015-03-13 10:33:42,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,095 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,095 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,095 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,096 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006_conf.xml
2015-03-13 10:33:42,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,097 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004_conf.xml
2015-03-13 10:33:42,097 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005_conf.xml
2015-03-13 10:33:42,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary dst=null perm=null
2015-03-13 10:33:42,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary dst=null perm=null
2015-03-13 10:33:42,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary dst=null perm=null
2015-03-13 10:33:42,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53277, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 168000
2015-03-13 10:33:42,100 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0008,submitTime=1426267969680,launchTime=1426267973437,firstMapTaskLaunchTime=1426267975608,firstReduceTaskLaunchTime=1426267985538,finishTime=1426267988140,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=2,jobName=[F9B537FAC95645ECA39BE2CD77067409/E03532BB4F26472AB8B07F9C2D7BA44F] trap test/(1/1) ...-mr1/trapplatform/seq/tap
2015-03-13 10:33:42,100 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary]
2015-03-13 10:33:42,100 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0007,submitTime=1426267954642,launchTime=1426267958248,firstMapTaskLaunchTime=1426267960403,firstReduceTaskLaunchTime=0,finishTime=1426267968284,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=0,jobName=[F2851B067A5340D8BCD42F553ADE00B9/2D32D0260D4B4807B8F7ECFBFF3D0CCC] trap test/(1/1) ...hain/tap-nondeterministic
2015-03-13 10:33:42,100 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary]
2015-03-13 10:33:42,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53274, bytes: 442, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 219000
2015-03-13 10:33:42,101 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53278, bytes: 437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 176000
2015-03-13 10:33:42,102 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741923_1099 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:33:42,102 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0009,submitTime=1426267989538,launchTime=1426267993335,firstMapTaskLaunchTime=1426267995505,firstReduceTaskLaunchTime=0,finishTime=1426268004678,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotSeconds=0,jobName=[A48777BC2FF94C92AE93C35F857FE6CB/2BD2562F74F34B63B0815D5262A06CC5] null/(1/1) ...tform/testTrapNoOperation
2015-03-13 10:33:42,102 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary]
2015-03-13 10:33:42,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary dst=null perm=null
2015-03-13 10:33:42,102 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741910_1086 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:33:42,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary dst=null perm=null
2015-03-13 10:33:42,104 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741935_1111 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:33:42,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary dst=null perm=null
2015-03-13 10:33:42,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,105 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,105 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist
2015-03-13 10:33:42,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:33:42,109 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist
2015-03-13 10:33:42,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,109 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007_conf.xml
2015-03-13 10:33:42,110 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008_conf.xml
2015-03-13 10:33:42,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,110 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009_conf.xml
2015-03-13 10:33:42,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:42,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:42,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:42,616 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:33:43,030 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741858_1034, blk_1073741910_1086, blk_1073741848_1024, blk_1073741837_1013, blk_1073741935_1111, blk_1073741871_1047]
2015-03-13 10:33:43,030 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741858_1034, blk_1073741923_1099, blk_1073741893_1069, blk_1073741848_1024, blk_1073741883_1059, blk_1073741837_1013, blk_1073741935_1111, blk_1073741871_1047]
2015-03-13 10:33:43,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:43,358 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:43,647 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858 for deletion
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923 for deletion
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893 for deletion
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848 for deletion
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883 for deletion
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923
2015-03-13 10:33:43,648 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837 for deletion
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871 for deletion
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935 for deletion
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871
2015-03-13 10:33:43,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935
2015-03-13 10:33:44,034 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858 for deletion
2015-03-13 10:33:44,034 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910 for deletion
2015-03-13 10:33:44,034 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848 for deletion
2015-03-13 10:33:44,034 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837 for deletion
2015-03-13 10:33:44,034 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871 for deletion
2015-03-13 10:33:44,034 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935 for deletion
2015-03-13 10:33:44,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858
2015-03-13 10:33:44,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848
2015-03-13 10:33:44,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837
2015-03-13 10:33:44,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935
2015-03-13 10:33:44,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910
2015-03-13 10:33:44,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871
2015-03-13 10:33:44,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary dst=null perm=null
2015-03-13 10:33:44,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:44,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,186 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:44,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:44,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120 src: /127.0.0.1:53283 dest: /127.0.0.1:52454
2015-03-13 10:33:44,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120 src: /127.0.0.1:53284 dest: /127.0.0.1:52447
2015-03-13 10:33:44,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120 src: /127.0.0.1:53285 dest: /127.0.0.1:52444
2015-03-13 10:33:44,260 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53285, dest: /127.0.0.1:52444, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 8780000
2015-03-13 10:33:44,260 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,260 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:44,260 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53284, dest: /127.0.0.1:52447, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 9492000
2015-03-13 10:33:44,261 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,261 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:44,261 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53283, dest: /127.0.0.1:52454, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 10538000
2015-03-13 10:33:44,262 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,262 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:44,265 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1
2015-03-13 10:33:44,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:44,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000 dst=null perm=null
2015-03-13 10:33:44,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,294 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1
2015-03-13 10:33:44,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0 dst=null perm=null
2015-03-13 10:33:44,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000 dst=null perm=null
2015-03-13 10:33:44,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:44,313 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000006
2015-03-13 10:33:44,314 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:44,314 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:33:44,314 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000006
2015-03-13 10:33:44,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:44,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,321 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1 dst=null perm=null
2015-03-13 10:33:44,326 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000006 is : 143
2015-03-13 10:33:44,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:44,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:44,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000 dst=null perm=null
2015-03-13 10:33:44,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000 dst=null perm=null
2015-03-13 10:33:44,339 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:44,339 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,339 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,340 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:44,340 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:44,340 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000006 from application application_1426267835672_0010
2015-03-13 10:33:44,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,340 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:44,341 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:44,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary dst=null perm=null
2015-03-13 10:33:44,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,351 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,354 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,360 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:44,368 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53272, dest: /127.0.0.1:52451, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 5328958000
2015-03-13 10:33:44,369 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,369 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,370 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53271, dest: /127.0.0.1:52447, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 5329056000
2015-03-13 10:33:44,370 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,371 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,371 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53270, dest: /127.0.0.1:52454, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 5331591000
2015-03-13 10:33:44,371 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,372 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,373 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,377 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:44,379 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121 src: /127.0.0.1:53286 dest: /127.0.0.1:52444
2015-03-13 10:33:44,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121 src: /127.0.0.1:53287 dest: /127.0.0.1:52454
2015-03-13 10:33:44,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121 src: /127.0.0.1:53288 dest: /127.0.0.1:52447
2015-03-13 10:33:44,384 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53288, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, duration: 1247000
2015-03-13 10:33:44,384 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,385 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:44,385 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53287, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, duration: 1838000
2015-03-13 10:33:44,385 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,385 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:44,386 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53286, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, duration: 2741000
2015-03-13 10:33:44,386 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,386 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:44,388 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist dst=null perm=null
2015-03-13 10:33:44,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:33:44,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist dst=null perm=null
2015-03-13 10:33:44,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:33:44,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist dst=null perm=null
2015-03-13 10:33:44,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,405 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53289, bytes: 60210, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 220000
2015-03-13 10:33:44,407 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:44,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122 src: /127.0.0.1:53290 dest: /127.0.0.1:52447
2015-03-13 10:33:44,410 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122 src: /127.0.0.1:53291 dest: /127.0.0.1:52451
2015-03-13 10:33:44,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122 src: /127.0.0.1:53292 dest: /127.0.0.1:52454
2015-03-13 10:33:44,414 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53292, dest: /127.0.0.1:52454, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, duration: 1334000
2015-03-13 10:33:44,414 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,414 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:44,414 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53291, dest: /127.0.0.1:52451, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, duration: 1871000
2015-03-13 10:33:44,415 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,415 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:44,415 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53290, dest: /127.0.0.1:52447, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, duration: 2721000
2015-03-13 10:33:44,415 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,416 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:44,418 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml dst=null perm=null
2015-03-13 10:33:44,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp dst=null perm=null
2015-03-13 10:33:44,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml dst=null perm=null
2015-03-13 10:33:44,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp dst=null perm=null
2015-03-13 10:33:44,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml dst=null perm=null
2015-03-13 10:33:44,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,429 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53289, bytes: 91461, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 281000
2015-03-13 10:33:44,431 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:44,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123 src: /127.0.0.1:53293 dest: /127.0.0.1:52444
2015-03-13 10:33:44,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123 src: /127.0.0.1:53294 dest: /127.0.0.1:52447
2015-03-13 10:33:44,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123 src: /127.0.0.1:53295 dest: /127.0.0.1:52451
2015-03-13 10:33:44,440 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53295, dest: /127.0.0.1:52451, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, duration: 2146000
2015-03-13 10:33:44,440 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,441 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,441 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53294, dest: /127.0.0.1:52447, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, duration: 2754000
2015-03-13 10:33:44,441 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,443 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53293, dest: /127.0.0.1:52444, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, duration: 4783000
2015-03-13 10:33:44,443 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,444 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,445 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,447 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,459 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from RUNNING to FINISHING
2015-03-13 10:33:44,460 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0010
2015-03-13 10:33:44,460 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from RUNNING to REMOVING
2015-03-13 10:33:44,460 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0010
2015-03-13 10:33:44,460 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from REMOVING to FINISHING
2015-03-13 10:33:45,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:45,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000006
2015-03-13 10:33:45,316 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:45,316 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:33:45,316 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:45,316 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:45,316 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:45,317 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:45,317 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:45,317 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:45,317 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000006 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:45,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:45,469 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741938_1114 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:33:45,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741939_1115 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444
2015-03-13 10:33:45,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741940_1116 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:33:45,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741941_1117 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444
2015-03-13 10:33:45,470 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741943_1119 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:33:45,471 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741942_1118 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:33:45,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010 dst=null perm=null
2015-03-13 10:33:45,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,501 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary
2015-03-13 10:33:45,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary dst=null perm=null
2015-03-13 10:33:45,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,502 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary
2015-03-13 10:33:45,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary dst=null perm=null
2015-03-13 10:33:45,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary dst=null perm=null
2015-03-13 10:33:45,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,511 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:45,512 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:45,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,514 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:45,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000 dst=null perm=null
2015-03-13 10:33:45,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:45,522 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:45,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,525 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:45,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:33:45,528 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53296, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 174000
2015-03-13 10:33:45,528 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everystart/tap
2015-03-13 10:33:45,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap dst=null perm=null
2015-03-13 10:33:45,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000 dst=null perm=null
2015-03-13 10:33:45,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000 dst=null perm=null
2015-03-13 10:33:45,532 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everystart/trap
2015-03-13 10:33:45,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap dst=null perm=null
2015-03-13 10:33:45,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:33:45,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000 dst=null perm=null
2015-03-13 10:33:45,537 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53297, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 163000
2015-03-13 10:33:45,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:45,547 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,548 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:33:45,548 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:33:45,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:33:45,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap dst=null perm=null
2015-03-13 10:33:45,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:33:45,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:33:45,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap"]
2015-03-13 10:33:45,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:33:45,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:33:45,559 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:33:45,560 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...mr1/trapplatform/none/tap
2015-03-13 10:33:45,570 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:45,577 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:45,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:33:45,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:45,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:45,581 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 11
2015-03-13 10:33:45,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011 dst=null perm=null
2015-03-13 10:33:45,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:33:45,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:33:45,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:45,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,588 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:45,589 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53299 dest: /127.0.0.1:52447
2015-03-13 10:33:45,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53300 dest: /127.0.0.1:52454
2015-03-13 10:33:45,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53301 dest: /127.0.0.1:52451
2015-03-13 10:33:45,595 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53301, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 1850000
2015-03-13 10:33:45,596 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,596 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,596 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53300, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 2620000
2015-03-13 10:33:45,596 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,597 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,597 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53299, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 3595000
2015-03-13 10:33:45,597 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,598 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,599 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,600 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar
2015-03-13 10:33:45,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:45,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:45,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:45,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:45,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:33:45,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:33:45,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:33:45,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:33:45,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:33:45,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:45,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:45,607 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:45,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:45,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,611 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split
2015-03-13 10:33:45,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:45,613 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:45,614 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53302 dest: /127.0.0.1:52454
2015-03-13 10:33:45,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53303 dest: /127.0.0.1:52444
2015-03-13 10:33:45,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53304 dest: /127.0.0.1:52451
2015-03-13 10:33:45,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53305 dest: /127.0.0.1:52447
2015-03-13 10:33:45,621 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53305, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 1638000
2015-03-13 10:33:45,621 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,622 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,622 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53304, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 2161000
2015-03-13 10:33:45,622 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,622 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,623 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53303, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 3147000
2015-03-13 10:33:45,623 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,623 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,623 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53302, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 3566000
2015-03-13 10:33:45,623 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,627 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,628 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,632 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:45,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126 src: /127.0.0.1:53306 dest: /127.0.0.1:52444
2015-03-13 10:33:45,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126 src: /127.0.0.1:53307 dest: /127.0.0.1:52454
2015-03-13 10:33:45,636 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126 src: /127.0.0.1:53308 dest: /127.0.0.1:52451
2015-03-13 10:33:45,638 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53308, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 1030000
2015-03-13 10:33:45,638 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,639 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,639 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53307, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 1499000
2015-03-13 10:33:45,639 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,639 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,640 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53306, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 2263000
2015-03-13 10:33:45,640 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,641 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,642 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,642 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:33:45,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,645 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:45,646 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:45,649 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:45,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127 src: /127.0.0.1:53309 dest: /127.0.0.1:52454
2015-03-13 10:33:45,651 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127 src: /127.0.0.1:53310 dest: /127.0.0.1:52444
2015-03-13 10:33:45,652 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127 src: /127.0.0.1:53311 dest: /127.0.0.1:52447
2015-03-13 10:33:45,655 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53311, dest: /127.0.0.1:52447, bytes: 97998, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 1677000
2015-03-13 10:33:45,655 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,655 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,656 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53310, dest: /127.0.0.1:52444, bytes: 97998, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 2107000
2015-03-13 10:33:45,656 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,656 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,656 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53309, dest: /127.0.0.1:52454, bytes: 97998, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 2952000
2015-03-13 10:33:45,657 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,657 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,658 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,658 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0011
2015-03-13 10:33:45,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011 dst=null perm=null
2015-03-13 10:33:45,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:45,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:45,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:45,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:45,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:45,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:45,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:45,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:45,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:45,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:45,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:45,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:45,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:45,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:45,671 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 11 submitted by user soberoi
2015-03-13 10:33:45,671 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0011
2015-03-13 10:33:45,671 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0011
2015-03-13 10:33:45,671 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0011
2015-03-13 10:33:45,671 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from NEW to NEW_SAVING
2015-03-13 10:33:45,671 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:33:45,671 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0011_000001
2015-03-13 10:33:45,672 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from NEW to SUBMITTED
2015-03-13 10:33:45,672 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0011 from user: soberoi activated in queue: default
2015-03-13 10:33:45,672 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0011 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:33:45,672 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0011 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:33:45,672 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0011 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:45,672 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0011_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:33:45,673 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:33:45,673 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from SUBMITTED to ACCEPTED
2015-03-13 10:33:45,675 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0011/
2015-03-13 10:33:45,675 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0011
2015-03-13 10:33:45,675 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0011/
2015-03-13 10:33:46,036 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52451 to replicate blk_1073741948_1124 to datanode(s) 127.0.0.1:52444
2015-03-13 10:33:46,036 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741942_1118, blk_1073741943_1119]
2015-03-13 10:33:46,036 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741938_1114, blk_1073741939_1115, blk_1073741941_1117, blk_1073741943_1119]
2015-03-13 10:33:46,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:46,317 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:33:46,317 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:33:46,317 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:46,317 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:33:46,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:46,317 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:46,318 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0011 AttemptId: appattempt_1426267835672_0011_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:33:46,318 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:33:46,319 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0011_000001
2015-03-13 10:33:46,319 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:33:46,319 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0011_000001
2015-03-13 10:33:46,319 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0011_000001
2015-03-13 10:33:46,320 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0011_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:33:46,322 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:46,324 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000001 by user soberoi
2015-03-13 10:33:46,324 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0011
2015-03-13 10:33:46,325 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:33:46,325 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from NEW to INITING
2015-03-13 10:33:46,325 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000001 to application application_1426267835672_0011
2015-03-13 10:33:46,325 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from INITING to RUNNING
2015-03-13 10:33:46,325 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0011_000001
2015-03-13 10:33:46,325 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:33:46,325 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:33:46,325 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:46,326 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0011_01_000001
2015-03-13 10:33:46,334 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0011_01_000001.tokens. Credentials list:
2015-03-13 10:33:46,349 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:46,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:46,418 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0011_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001.tokens
2015-03-13 10:33:46,418 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:33:46,463 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122
2015-03-13 10:33:46,463 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119
2015-03-13 10:33:46,464 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:46,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:46,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121
2015-03-13 10:33:46,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126
2015-03-13 10:33:46,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:46,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:46,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:46,485 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120
2015-03-13 10:33:46,485 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127
2015-03-13 10:33:46,487 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:46,487 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:46,489 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53296, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 540000
2015-03-13 10:33:46,508 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:46,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:46,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:46,533 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53315, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 181000
2015-03-13 10:33:46,546 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:46,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:46,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:46,570 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53316, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 195000
2015-03-13 10:33:46,583 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:46,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:46,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:46,606 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53296, bytes: 98766, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 314000
2015-03-13 10:33:46,620 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,620 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:46,645 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:46,645 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:46,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:46,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:46,649 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941 for deletion
2015-03-13 10:33:46,650 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943 for deletion
2015-03-13 10:33:46,650 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:46,650 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:46,650 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941
2015-03-13 10:33:46,650 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943
2015-03-13 10:33:46,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127
2015-03-13 10:33:46,669 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120
2015-03-13 10:33:46,688 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119
2015-03-13 10:33:46,689 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122
2015-03-13 10:33:46,689 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121
2015-03-13 10:33:46,690 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123
2015-03-13 10:33:46,716 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001/default_container_executor.sh]
2015-03-13 10:33:46,717 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:46,719 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:46,719 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126
2015-03-13 10:33:46,908 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 to 127.0.0.1:52444
2015-03-13 10:33:46,909 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53317 dest: /127.0.0.1:52444
2015-03-13 10:33:46,909 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 (numBytes=254067) to /127.0.0.1:52444
2015-03-13 10:33:46,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53317 dest: /127.0.0.1:52444 of size 254067
2015-03-13 10:33:46,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741948_1124 size 254067
2015-03-13 10:33:46,921 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122
2015-03-13 10:33:46,922 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123
2015-03-13 10:33:46,922 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119
2015-03-13 10:33:47,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:47,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:47,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940 for deletion
2015-03-13 10:33:47,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:47,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:47,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940
2015-03-13 10:33:47,035 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942 for deletion
2015-03-13 10:33:47,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943 for deletion
2015-03-13 10:33:47,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942
2015-03-13 10:33:47,036 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943
2015-03-13 10:33:47,103 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121
2015-03-13 10:33:47,104 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120
2015-03-13 10:33:47,104 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:47,104 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127
2015-03-13 10:33:47,307 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:47,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:47,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:47,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:47,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123
2015-03-13 10:33:47,509 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126
2015-03-13 10:33:48,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:33:48,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_STARTED dst=null perm=null
2015-03-13 10:33:48,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:33:48,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_FAIL dst=null perm=null
2015-03-13 10:33:48,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:48,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011 dst=null perm=null
2015-03-13 10:33:48,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:33:48,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:33:48,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:48,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:48,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:33:48,679 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53319, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 183000
2015-03-13 10:33:49,042 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741938_1114, blk_1073741939_1115, blk_1073741923_1099, blk_1073741940_1116, blk_1073741941_1117, blk_1073741893_1069, blk_1073741942_1118, blk_1073741910_1086, blk_1073741943_1119, blk_1073741883_1059, blk_1073741935_1111, blk_1073741871_1047]
2015-03-13 10:33:49,042 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741938_1114, blk_1073741858_1034, blk_1073741939_1115, blk_1073741923_1099, blk_1073741940_1116, blk_1073741941_1117, blk_1073741893_1069, blk_1073741942_1118, blk_1073741910_1086, blk_1073741848_1024, blk_1073741883_1059, blk_1073741837_1013]
2015-03-13 10:33:49,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:49,377 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:49,441 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:49,442 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0011_000001
2015-03-13 10:33:49,443 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0011 APPATTEMPTID=appattempt_1426267835672_0011_000001
2015-03-13 10:33:49,444 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:33:49,445 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from ACCEPTED to RUNNING
2015-03-13 10:33:49,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:49,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:49,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858 for deletion
2015-03-13 10:33:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923 for deletion
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940 for deletion
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893 for deletion
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941 for deletion
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940
2015-03-13 10:33:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910 for deletion
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942 for deletion
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848 for deletion
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883 for deletion
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837 for deletion
2015-03-13 10:33:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848
2015-03-13 10:33:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883
2015-03-13 10:33:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837
2015-03-13 10:33:49,676 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:49,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128 src: /127.0.0.1:53325 dest: /127.0.0.1:52454
2015-03-13 10:33:49,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128 src: /127.0.0.1:53326 dest: /127.0.0.1:52447
2015-03-13 10:33:49,716 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128 src: /127.0.0.1:53327 dest: /127.0.0.1:52451
2015-03-13 10:33:49,725 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53327, dest: /127.0.0.1:52451, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 7308000
2015-03-13 10:33:49,725 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:49,726 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:49,726 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53326, dest: /127.0.0.1:52447, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 7927000
2015-03-13 10:33:49,726 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:49,727 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:49,727 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53325, dest: /127.0.0.1:52454, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 8819000
2015-03-13 10:33:49,727 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:49,727 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:49,731 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:33:49,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:49,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923 for deletion
2015-03-13 10:33:49,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:49,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941 for deletion
2015-03-13 10:33:49,912 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871 for deletion
2015-03-13 10:33:49,913 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935 for deletion
2015-03-13 10:33:49,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893
2015-03-13 10:33:49,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942
2015-03-13 10:33:49,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910
2015-03-13 10:33:49,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883
2015-03-13 10:33:49,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943
2015-03-13 10:33:49,914 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871
2015-03-13 10:33:49,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935
2015-03-13 10:33:50,324 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:50,380 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:50,600 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0010_01_000001 succeeded
2015-03-13 10:33:50,600 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:33:50,601 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000001
2015-03-13 10:33:50,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,610 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:50,610 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:33:50,610 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000001 from application application_1426267835672_0010
2015-03-13 10:33:50,610 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:50,610 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:51,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:51,327 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,327 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:51,327 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:33:51,328 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,328 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:33:51,328 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,329 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,329 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:51,329 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:33:51,329 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,329 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:33:51,330 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:33:51,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000001
2015-03-13 10:33:51,381 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:51,381 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0010_000001
2015-03-13 10:33:51,381 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:33:51,382 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from FINISHING to FINISHED
2015-03-13 10:33:51,382 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0010 CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:51,382 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from FINISHING to FINISHED
2015-03-13 10:33:51,382 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:51,382 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0010_000001
2015-03-13 10:33:51,382 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:51,382 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0010
2015-03-13 10:33:51,383 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,383 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0010,name=[424430AA625046EFAE20EBF78BBDDDC5/B5554EC049CD4334A41B4BB54C1B7AD7] trap test/(1/1) ...applatform/everystart/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0010/jobhistory/job/job_1426267835672_0010,appMasterHost=Edinburgh.local,startTime=1426268006031,finishTime=1426268024460,finalStatus=SUCCEEDED
2015-03-13 10:33:51,383 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,383 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:33:51,383 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000001 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:51,384 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,384 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:51,384 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:51,384 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0011_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,384 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-03-13 10:33:51,384 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,385 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:51,385 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:33:51,385 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0011_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,385 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:33:51,386 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:51,386 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,386 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0010_000001 is done. finalState=FINISHED
2015-03-13 10:33:51,386 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0010 requests cleared
2015-03-13 10:33:51,386 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0010 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:33:51,386 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0010 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:33:51,387 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000001
2015-03-13 10:33:51,483 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,484 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,484 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,484 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:51,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:51,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:51,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:51,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:51,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:51,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:51,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:51,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:33:51,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:33:51,588 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:51,589 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:51,592 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000004 by user soberoi
2015-03-13 10:33:51,593 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0011
2015-03-13 10:33:51,593 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:51,593 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000005 by user soberoi
2015-03-13 10:33:51,594 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:51,594 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from NEW to INITING
2015-03-13 10:33:51,594 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000004 to application application_1426267835672_0011
2015-03-13 10:33:51,594 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000005 to application application_1426267835672_0011
2015-03-13 10:33:51,594 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from INITING to RUNNING
2015-03-13 10:33:51,594 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,595 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,595 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,595 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,595 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:51,595 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:51,595 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,596 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,596 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0011_01_000005
2015-03-13 10:33:51,597 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0011_01_000004
2015-03-13 10:33:51,597 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000003 by user soberoi
2015-03-13 10:33:51,597 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000002 by user soberoi
2015-03-13 10:33:51,597 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:51,598 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000003 to application application_1426267835672_0011
2015-03-13 10:33:51,598 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000002 to application application_1426267835672_0011
2015-03-13 10:33:51,598 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,598 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,598 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,598 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,598 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,598 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,599 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,599 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,599 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,599 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,597 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:51,599 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,600 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,622 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0011_01_000004.tokens. Credentials list:
2015-03-13 10:33:51,623 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0011_01_000005.tokens. Credentials list:
2015-03-13 10:33:51,643 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,643 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:51,643 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,643 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:51,648 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:51,677 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128
2015-03-13 10:33:51,694 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128
2015-03-13 10:33:51,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003/default_container_executor.sh]
2015-03-13 10:33:51,741 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002/default_container_executor.sh]
2015-03-13 10:33:51,751 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0011_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004.tokens
2015-03-13 10:33:51,752 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:33:51,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:51,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:51,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar dst=null perm=null
2015-03-13 10:33:51,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53333, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1607912123_5613, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 504000
2015-03-13 10:33:51,880 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:51,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:51,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:51,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml dst=null perm=null
2015-03-13 10:33:51,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53334, bytes: 98766, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1607912123_5613, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 285000
2015-03-13 10:33:51,928 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128
2015-03-13 10:33:51,934 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:51,934 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,935 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,977 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,977 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:51,978 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,978 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:52,087 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005/default_container_executor.sh]
2015-03-13 10:33:52,087 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004/default_container_executor.sh]
2015-03-13 10:33:52,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,328 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,328 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,328 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:52,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,328 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,329 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0010
2015-03-13 10:33:52,329 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:52,329 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0010, with delay of 10800 seconds
2015-03-13 10:33:52,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,382 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,382 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:52,382 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,382 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0010
2015-03-13 10:33:52,383 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:52,383 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0010, with delay of 10800 seconds
2015-03-13 10:33:52,497 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:33:52,966 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:53,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0011_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005.tokens
2015-03-13 10:33:53,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:33:53,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,335 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,342 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,342 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,342 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,345 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,345 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,405 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,405 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:57,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:58,005 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53342, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000001_0_1183001864_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 155000
2015-03-13 10:33:58,024 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53343, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000000_0_566049093_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 160000
2015-03-13 10:33:58,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:58,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split dst=null perm=null
2015-03-13 10:33:58,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:58,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:58,180 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53346, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000000_0_566049093_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 156000
2015-03-13 10:33:58,223 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53347, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000003_0_129198942_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 161000
2015-03-13 10:33:58,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53348, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000002_0_183374136_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 187000
2015-03-13 10:33:58,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:58,310 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53349, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000003_0_129198942_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 158000
2015-03-13 10:33:58,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,350 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,350 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:33:58,398 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53350, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000002_0_183374136_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1099000
2015-03-13 10:33:58,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,411 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,535 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53351, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000001_0_1183001864_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 150000
2015-03-13 10:33:58,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000001_0 dst=null perm=null
2015-03-13 10:33:58,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000000_0 dst=null perm=null
2015-03-13 10:33:58,598 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000003
2015-03-13 10:33:58,598 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:58,598 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,598 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000003
2015-03-13 10:33:58,598 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,598 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,599 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,611 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000003 is : 143
2015-03-13 10:33:58,614 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:58,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129 src: /127.0.0.1:53352 dest: /127.0.0.1:52447
2015-03-13 10:33:58,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129 src: /127.0.0.1:53353 dest: /127.0.0.1:52454
2015-03-13 10:33:58,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129 src: /127.0.0.1:53354 dest: /127.0.0.1:52444
2015-03-13 10:33:58,624 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist for DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:33:58,625 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,626 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000003 from application application_1426267835672_0011
2015-03-13 10:33:58,627 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,627 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:58,644 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000002
2015-03-13 10:33:58,644 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:58,644 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,644 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000002
2015-03-13 10:33:58,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:58,645 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000003
2015-03-13 10:33:58,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:58,646 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:58,646 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:58,646 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:33:58,646 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:58,646 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,646 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,646 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:58,647 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000003 on node: host: 10.1.1.144:52477 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:58,656 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000002 is : 143
2015-03-13 10:33:58,668 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,670 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,670 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,670 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:58,671 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,671 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000002 from application application_1426267835672_0011
2015-03-13 10:33:58,671 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,671 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:58,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000003_0 dst=null perm=null
2015-03-13 10:33:58,754 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000005
2015-03-13 10:33:58,755 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:58,755 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,755 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000005
2015-03-13 10:33:58,755 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,755 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,764 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000005 is : 143
2015-03-13 10:33:58,774 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,774 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,774 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,776 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000005 from application application_1426267835672_0011
2015-03-13 10:33:58,776 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,776 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:58,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000002_0 dst=null perm=null
2015-03-13 10:33:58,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000004
2015-03-13 10:33:58,798 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:58,798 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,798 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000004
2015-03-13 10:33:58,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:58,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000005
2015-03-13 10:33:58,799 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:58,799 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:58,799 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:58,799 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:58,800 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:58,800 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,800 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,800 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:58,800 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000005 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:58,808 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000004 is : 143
2015-03-13 10:33:58,816 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:58,818 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,818 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000004 from application application_1426267835672_0011
2015-03-13 10:33:58,818 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,818 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:59,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:59,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:59,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000002
2015-03-13 10:33:59,647 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:59,647 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:59,647 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:59,647 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:59,648 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:59,648 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,648 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,648 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:59,648 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000002 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:59,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:59,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000004
2015-03-13 10:33:59,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:59,803 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:59,803 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:59,803 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:59,804 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:59,804 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,804 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,804 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:59,804 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000004 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:00,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:00,649 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:00,649 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:00,649 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:34:00,649 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:00,649 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:34:00,650 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:01,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:01,552 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000006 by user soberoi
2015-03-13 10:34:01,552 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:01,552 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000006 to application application_1426267835672_0011
2015-03-13 10:34:01,553 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:34:01,553 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:34:01,553 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:34:01,553 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:01,553 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:34:01,553 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:01,582 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:01,582 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:01,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:01,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:01,653 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:01,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006/default_container_executor.sh]
2015-03-13 10:34:02,547 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:34:02,653 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:02,653 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:03,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:03,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:03,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,033 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,090 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130 src: /127.0.0.1:53360 dest: /127.0.0.1:52447
2015-03-13 10:34:04,091 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130 src: /127.0.0.1:53361 dest: /127.0.0.1:52454
2015-03-13 10:34:04,092 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130 src: /127.0.0.1:53362 dest: /127.0.0.1:52451
2015-03-13 10:34:04,102 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53362, dest: /127.0.0.1:52451, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 8640000
2015-03-13 10:34:04,103 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,103 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,103 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53361, dest: /127.0.0.1:52454, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 9282000
2015-03-13 10:34:04,103 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,104 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53360, dest: /127.0.0.1:52447, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 10198000
2015-03-13 10:34:04,104 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,108 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1
2015-03-13 10:34:04,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0 dst=null perm=null
2015-03-13 10:34:04,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0 dst=null perm=null
2015-03-13 10:34:04,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000 dst=null perm=null
2015-03-13 10:34:04,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:04,133 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000006
2015-03-13 10:34:04,134 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:04,134 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:34:04,134 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000006
2015-03-13 10:34:04,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:04,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:04,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,141 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1 dst=null perm=null
2015-03-13 10:34:04,145 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000006 is : 143
2015-03-13 10:34:04,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:04,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:04,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000 dst=null perm=null
2015-03-13 10:34:04,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000 dst=null perm=null
2015-03-13 10:34:04,155 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:04,155 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,156 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:04,157 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000006 from application application_1426267835672_0011
2015-03-13 10:34:04,157 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:04,157 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:34:04,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary dst=null perm=null
2015-03-13 10:34:04,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,166 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,169 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,182 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53354, dest: /127.0.0.1:52444, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 5561701000
2015-03-13 10:34:04,183 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,183 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:04,184 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53353, dest: /127.0.0.1:52454, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 5562170000
2015-03-13 10:34:04,184 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,185 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:04,185 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53352, dest: /127.0.0.1:52447, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 5564209000
2015-03-13 10:34:04,185 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,186 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:04,187 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,191 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,193 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131 src: /127.0.0.1:53363 dest: /127.0.0.1:52444
2015-03-13 10:34:04,195 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131 src: /127.0.0.1:53364 dest: /127.0.0.1:52454
2015-03-13 10:34:04,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131 src: /127.0.0.1:53365 dest: /127.0.0.1:52451
2015-03-13 10:34:04,198 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53365, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, duration: 1512000
2015-03-13 10:34:04,198 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,199 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,199 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53364, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, duration: 1971000
2015-03-13 10:34:04,199 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,200 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,200 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53363, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, duration: 2970000
2015-03-13 10:34:04,200 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,200 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,202 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist dst=null perm=null
2015-03-13 10:34:04,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:34:04,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist dst=null perm=null
2015-03-13 10:34:04,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:34:04,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist dst=null perm=null
2015-03-13 10:34:04,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,223 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53366, bytes: 60422, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 201000
2015-03-13 10:34:04,225 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132 src: /127.0.0.1:53367 dest: /127.0.0.1:52454
2015-03-13 10:34:04,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132 src: /127.0.0.1:53368 dest: /127.0.0.1:52444
2015-03-13 10:34:04,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132 src: /127.0.0.1:53369 dest: /127.0.0.1:52451
2015-03-13 10:34:04,231 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53369, dest: /127.0.0.1:52451, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, duration: 1674000
2015-03-13 10:34:04,231 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,232 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,232 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53368, dest: /127.0.0.1:52444, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, duration: 2315000
2015-03-13 10:34:04,232 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,232 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,233 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53367, dest: /127.0.0.1:52454, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, duration: 3125000
2015-03-13 10:34:04,233 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,233 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,235 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml dst=null perm=null
2015-03-13 10:34:04,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp dst=null perm=null
2015-03-13 10:34:04,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml dst=null perm=null
2015-03-13 10:34:04,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp dst=null perm=null
2015-03-13 10:34:04,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml dst=null perm=null
2015-03-13 10:34:04,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,246 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53370, bytes: 91303, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 274000
2015-03-13 10:34:04,248 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133 src: /127.0.0.1:53371 dest: /127.0.0.1:52454
2015-03-13 10:34:04,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133 src: /127.0.0.1:53372 dest: /127.0.0.1:52447
2015-03-13 10:34:04,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133 src: /127.0.0.1:53373 dest: /127.0.0.1:52451
2015-03-13 10:34:04,255 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53373, dest: /127.0.0.1:52451, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, duration: 1802000
2015-03-13 10:34:04,255 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,255 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53372, dest: /127.0.0.1:52447, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, duration: 2282000
2015-03-13 10:34:04,256 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,256 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53371, dest: /127.0.0.1:52454, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, duration: 3018000
2015-03-13 10:34:04,256 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,258 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,271 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from RUNNING to FINISHING
2015-03-13 10:34:04,271 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0011
2015-03-13 10:34:04,271 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from RUNNING to REMOVING
2015-03-13 10:34:04,272 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0011
2015-03-13 10:34:04,272 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from REMOVING to FINISHING
2015-03-13 10:34:05,139 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:05,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:05,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000006
2015-03-13 10:34:05,141 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:05,141 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:34:05,141 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:05,141 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:34:05,141 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:34:05,141 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,142 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,142 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:34:05,142 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000006 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:34:05,278 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741948_1124 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444
2015-03-13 10:34:05,278 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741949_1125 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447
2015-03-13 10:34:05,278 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741950_1126 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451
2015-03-13 10:34:05,278 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741951_1127 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:34:05,278 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741953_1129 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:34:05,278 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741952_1128 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451
2015-03-13 10:34:05,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011 dst=null perm=null
2015-03-13 10:34:05,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,317 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary
2015-03-13 10:34:05,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary dst=null perm=null
2015-03-13 10:34:05,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap dst=null perm=null
2015-03-13 10:34:05,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap dst=null perm=null
2015-03-13 10:34:05,329 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,329 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:05,329 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:05,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,332 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:34:05,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000 dst=null perm=null
2015-03-13 10:34:05,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53375, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 180000
2015-03-13 10:34:05,341 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,342 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:05,342 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:05,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap dst=null perm=null
2015-03-13 10:34:05,343 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/none/tap
2015-03-13 10:34:05,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap dst=null perm=null
2015-03-13 10:34:05,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000 dst=null perm=null
2015-03-13 10:34:05,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000 dst=null perm=null
2015-03-13 10:34:05,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53375, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 164000
2015-03-13 10:34:05,348 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/none/trap
2015-03-13 10:34:05,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap dst=null perm=null
2015-03-13 10:34:05,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:05,359 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,360 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:34:05,360 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:34:05,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:05,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:05,373 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:34:05,373 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:34:05,373 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] sink: Hfs["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap"]
2015-03-13 10:34:05,374 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] parallel execution is enabled: true
2015-03-13 10:34:05,374 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting jobs: 1
2015-03-13 10:34:05,374 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] allocating threads: 1
2015-03-13 10:34:05,375 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...1/trapplatform/allseq/tap
2015-03-13 10:34:05,382 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:34:05,391 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:34:05,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:05,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:34:05,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:34:05,395 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 12
2015-03-13 10:34:05,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012 dst=null perm=null
2015-03-13 10:34:05,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:34:05,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:34:05,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,401 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:34:05,402 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53377 dest: /127.0.0.1:52451
2015-03-13 10:34:05,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53378 dest: /127.0.0.1:52454
2015-03-13 10:34:05,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53379 dest: /127.0.0.1:52444
2015-03-13 10:34:05,408 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53379, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 1863000
2015-03-13 10:34:05,408 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,409 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,409 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53378, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 2295000
2015-03-13 10:34:05,409 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,409 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,409 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53377, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 3374000
2015-03-13 10:34:05,410 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,410 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,411 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,412 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar
2015-03-13 10:34:05,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:05,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:05,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:05,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:34:05,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:34:05,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:34:05,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:34:05,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:34:05,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:05,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:05,420 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:34:05,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:05,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,426 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split
2015-03-13 10:34:05,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:05,428 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:34:05,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53380 dest: /127.0.0.1:52451
2015-03-13 10:34:05,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53381 dest: /127.0.0.1:52447
2015-03-13 10:34:05,431 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53382 dest: /127.0.0.1:52454
2015-03-13 10:34:05,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53383 dest: /127.0.0.1:52444
2015-03-13 10:34:05,435 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53383, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 1502000
2015-03-13 10:34:05,436 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,436 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,436 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53382, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 2020000
2015-03-13 10:34:05,436 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,437 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,437 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53381, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 2894000
2015-03-13 10:34:05,437 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,438 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,438 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53380, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 3729000
2015-03-13 10:34:05,438 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,438 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,440 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,444 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:05,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136 src: /127.0.0.1:53384 dest: /127.0.0.1:52451
2015-03-13 10:34:05,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136 src: /127.0.0.1:53385 dest: /127.0.0.1:52447
2015-03-13 10:34:05,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136 src: /127.0.0.1:53386 dest: /127.0.0.1:52454
2015-03-13 10:34:05,449 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53386, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 1052000
2015-03-13 10:34:05,449 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,450 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,450 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53385, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 1548000
2015-03-13 10:34:05,450 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,450 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,451 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53384, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 2252000
2015-03-13 10:34:05,451 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,452 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,453 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,453 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:34:05,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,456 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:05,457 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:05,460 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:05,461 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137 src: /127.0.0.1:53387 dest: /127.0.0.1:52444
2015-03-13 10:34:05,462 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137 src: /127.0.0.1:53388 dest: /127.0.0.1:52451
2015-03-13 10:34:05,463 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137 src: /127.0.0.1:53389 dest: /127.0.0.1:52454
2015-03-13 10:34:05,466 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53389, dest: /127.0.0.1:52454, bytes: 98814, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 1439000
2015-03-13 10:34:05,466 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,467 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,467 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53388, dest: /127.0.0.1:52451, bytes: 98814, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 2067000
2015-03-13 10:34:05,467 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,468 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,468 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53387, dest: /127.0.0.1:52444, bytes: 98814, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 2854000
2015-03-13 10:34:05,468 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,469 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,470 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,470 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0012
2015-03-13 10:34:05,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012 dst=null perm=null
2015-03-13 10:34:05,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:05,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:05,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:05,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:05,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:05,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:05,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:05,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:05,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:05,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:05,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:05,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:05,485 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 12 submitted by user soberoi
2015-03-13 10:34:05,485 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0012
2015-03-13 10:34:05,485 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from NEW to NEW_SAVING
2015-03-13 10:34:05,485 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0012
2015-03-13 10:34:05,485 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426267835672_0012
2015-03-13 10:34:05,486 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:34:05,486 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,486 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from NEW to SUBMITTED
2015-03-13 10:34:05,486 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0012 from user: soberoi activated in queue: default
2015-03-13 10:34:05,486 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0012 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:34:05,486 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0012 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:34:05,486 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0012 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:34:05,486 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0012_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:34:05,487 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:34:05,488 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from SUBMITTED to ACCEPTED
2015-03-13 10:34:05,489 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0012/
2015-03-13 10:34:05,489 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0012
2015-03-13 10:34:05,489 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0012/
2015-03-13 10:34:05,495 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:05,495 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000001
2015-03-13 10:34:05,495 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:34:05,495 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0012_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,495 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:34:05,496 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,496 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:05,496 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0012 AttemptId: appattempt_1426267835672_0012_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ]
2015-03-13 10:34:05,496 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:34:05,496 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,496 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:34:05,497 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0012_000001
2015-03-13 10:34:05,497 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,497 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0012_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:34:05,499 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:05,500 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000001 by user soberoi
2015-03-13 10:34:05,500 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0012
2015-03-13 10:34:05,501 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000001
2015-03-13 10:34:05,501 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from NEW to INITING
2015-03-13 10:34:05,501 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000001 to application application_1426267835672_0012
2015-03-13 10:34:05,501 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from INITING to RUNNING
2015-03-13 10:34:05,501 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,501 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:34:05,501 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:34:05,501 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:05,502 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000001
2015-03-13 10:34:05,511 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0012_01_000001.tokens. Credentials list:
2015-03-13 10:34:05,531 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:05,603 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0012_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000001.tokens
2015-03-13 10:34:05,603 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:05,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:05,672 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53393, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 464000
2015-03-13 10:34:05,691 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:05,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:05,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:05,715 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53375, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 126000
2015-03-13 10:34:05,728 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:05,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:05,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:05,753 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53393, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 174000
2015-03-13 10:34:05,766 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:05,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:05,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:05,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53393, bytes: 99586, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 280000
2015-03-13 10:34:05,802 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,802 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:05,828 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:05,829 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:05,897 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000001/default_container_executor.sh]
2015-03-13 10:34:06,142 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:06,497 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:06,497 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:06,687 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136
2015-03-13 10:34:06,688 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129
2015-03-13 10:34:06,688 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137
2015-03-13 10:34:06,709 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129
2015-03-13 10:34:06,709 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136
2015-03-13 10:34:06,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130
2015-03-13 10:34:06,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:06,711 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133
2015-03-13 10:34:06,892 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133
2015-03-13 10:34:06,893 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130
2015-03-13 10:34:06,944 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132
2015-03-13 10:34:06,946 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:06,947 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136
2015-03-13 10:34:06,947 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130
2015-03-13 10:34:06,947 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:07,059 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52451 to replicate blk_1073741958_1134 to datanode(s) 127.0.0.1:52447
2015-03-13 10:34:07,059 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741953_1129, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:34:07,059 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741952_1128, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126]
2015-03-13 10:34:07,092 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:07,093 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132
2015-03-13 10:34:07,093 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131
2015-03-13 10:34:07,094 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:07,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:07,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137
2015-03-13 10:34:07,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131
2015-03-13 10:34:07,149 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133
2015-03-13 10:34:07,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:34:07,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:07,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_STARTED dst=null perm=null
2015-03-13 10:34:07,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:34:07,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_FAIL dst=null perm=null
2015-03-13 10:34:07,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131
2015-03-13 10:34:07,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129
2015-03-13 10:34:07,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137
2015-03-13 10:34:07,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:07,522 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132
2015-03-13 10:34:07,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012 dst=null perm=null
2015-03-13 10:34:07,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:34:07,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953 for deletion
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950 for deletion
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951 for deletion
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:07,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:07,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951
2015-03-13 10:34:07,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950
2015-03-13 10:34:07,727 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:07,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:07,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:34:07,896 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53395, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 181000
2015-03-13 10:34:07,932 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 to 127.0.0.1:52447
2015-03-13 10:34:07,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952 for deletion
2015-03-13 10:34:07,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:07,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:07,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952
2015-03-13 10:34:07,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:07,934 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:34:07,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:07,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950 for deletion
2015-03-13 10:34:07,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53396 dest: /127.0.0.1:52447
2015-03-13 10:34:07,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950
2015-03-13 10:34:07,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53396 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:34:07,936 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741958_1134 size 254067
2015-03-13 10:34:08,149 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:08,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:08,656 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:08,657 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0012_000001
2015-03-13 10:34:08,657 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426267835672_0012 APPATTEMPTID=appattempt_1426267835672_0012_000001
2015-03-13 10:34:08,657 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:34:08,658 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from ACCEPTED to RUNNING
2015-03-13 10:34:08,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:08,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:08,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:08,864 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:08,903 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138 src: /127.0.0.1:53402 dest: /127.0.0.1:52447
2015-03-13 10:34:08,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138 src: /127.0.0.1:53403 dest: /127.0.0.1:52444
2015-03-13 10:34:08,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138 src: /127.0.0.1:53404 dest: /127.0.0.1:52454
2015-03-13 10:34:08,913 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53404, dest: /127.0.0.1:52454, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 5782000
2015-03-13 10:34:08,913 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:08,914 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:08,914 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53403, dest: /127.0.0.1:52444, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 6319000
2015-03-13 10:34:08,914 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:08,915 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:08,915 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53402, dest: /127.0.0.1:52447, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 7197000
2015-03-13 10:34:08,915 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:08,916 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:08,919 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:09,152 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:09,503 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:09,837 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,837 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:09,837 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:34:09,837 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,838 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:34:09,838 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,839 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,839 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:09,839 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:34:09,839 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,839 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:34:09,840 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,840 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,840 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:09,840 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:34:09,840 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,841 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:34:09,841 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,841 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,841 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:09,841 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:34:09,841 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,841 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:34:09,842 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:10,061 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741952_1128, blk_1073741953_1129, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:34:10,062 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741952_1128, blk_1073741953_1129, blk_1073741948_1124, blk_1073741949_1125, blk_1073741951_1127]
2015-03-13 10:34:10,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,413 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0011_01_000001 succeeded
2015-03-13 10:34:10,413 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:34:10,413 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:34:10,421 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000001 from application application_1426267835672_0011
2015-03-13 10:34:10,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,422 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:10,422 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:34:10,508 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952 for deletion
2015-03-13 10:34:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953 for deletion
2015-03-13 10:34:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952
2015-03-13 10:34:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951 for deletion
2015-03-13 10:34:10,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953
2015-03-13 10:34:10,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:10,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:10,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951
2015-03-13 10:34:10,689 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,689 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,690 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,690 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:10,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:10,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:10,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:10,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:10,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:10,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:10,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:10,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:34:10,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar dst=null perm=null
2015-03-13 10:34:10,814 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:10,817 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000002 by user soberoi
2015-03-13 10:34:10,818 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000005 by user soberoi
2015-03-13 10:34:10,818 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000004 by user soberoi
2015-03-13 10:34:10,818 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000003 by user soberoi
2015-03-13 10:34:10,818 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:10,818 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000005 to application application_1426267835672_0012
2015-03-13 10:34:10,818 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000004 to application application_1426267835672_0012
2015-03-13 10:34:10,818 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000003 to application application_1426267835672_0012
2015-03-13 10:34:10,818 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0012
2015-03-13 10:34:10,818 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:10,818 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:10,819 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from NEW to INITING
2015-03-13 10:34:10,819 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000002 to application application_1426267835672_0012
2015-03-13 10:34:10,819 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from INITING to RUNNING
2015-03-13 10:34:10,819 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,819 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,820 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,820 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,820 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,820 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,820 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:34:10,820 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:34:10,820 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,820 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,821 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,821 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,818 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:10,821 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,821 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,821 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000002
2015-03-13 10:34:10,822 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000004
2015-03-13 10:34:10,823 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000003
2015-03-13 10:34:10,825 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000005
2015-03-13 10:34:10,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,838 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,838 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,838 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,838 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,838 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,842 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000002.tokens. Credentials list:
2015-03-13 10:34:10,842 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000005.tokens. Credentials list:
2015-03-13 10:34:10,843 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0012_01_000003.tokens. Credentials list:
2015-03-13 10:34:10,843 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000004.tokens. Credentials list:
2015-03-13 10:34:10,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:10,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002.tokens
2015-03-13 10:34:10,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:10,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:10,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:10,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:10,995 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53408, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1439600372_5977, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 537000
2015-03-13 10:34:11,022 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:11,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:11,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:11,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:11,045 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53408, bytes: 99586, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1439600372_5977, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 198000
2015-03-13 10:34:11,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952 for deletion
2015-03-13 10:34:11,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953 for deletion
2015-03-13 10:34:11,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:11,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952
2015-03-13 10:34:11,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953
2015-03-13 10:34:11,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:11,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:11,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950 for deletion
2015-03-13 10:34:11,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951 for deletion
2015-03-13 10:34:11,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:11,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951
2015-03-13 10:34:11,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950
2015-03-13 10:34:11,059 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:11,059 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,059 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,059 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,059 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,101 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,102 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,102 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,102 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,156 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:34:11,156 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000001
2015-03-13 10:34:11,156 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:11,156 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0011_000001
2015-03-13 10:34:11,157 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from FINISHING to FINISHED
2015-03-13 10:34:11,157 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from FINISHING to FINISHED
2015-03-13 10:34:11,157 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426267835672_0011
2015-03-13 10:34:11,156 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:34:11,157 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0011,name=[58291EFD2AED461C931D8F05D84E7429/844068023FDE4ED89D2CDA92C3503422] trap test/(1/1) ...mr1/trapplatform/none/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0011/jobhistory/job/job_1426267835672_0011,appMasterHost=Edinburgh.local,startTime=1426268025670,finishTime=1426268044272,finalStatus=SUCCEEDED
2015-03-13 10:34:11,157 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0011_000001
2015-03-13 10:34:11,157 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0011 CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:34:11,158 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:34:11,158 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:34:11,158 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:11,158 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:11,158 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:34:11,158 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000001 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:11,158 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0011_000001 is done. finalState=FINISHED
2015-03-13 10:34:11,158 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0011 requests cleared
2015-03-13 10:34:11,158 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0011 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:34:11,159 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0011 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:34:11,161 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:34:11,163 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000001
2015-03-13 10:34:11,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003/default_container_executor.sh]
2015-03-13 10:34:11,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005/default_container_executor.sh]
2015-03-13 10:34:11,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004/default_container_executor.sh]
2015-03-13 10:34:11,211 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002/default_container_executor.sh]
2015-03-13 10:34:11,512 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,704 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:34:11,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,844 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:34:11,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,844 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0011
2015-03-13 10:34:11,844 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:34:11,844 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0011, with delay of 10800 seconds
2015-03-13 10:34:11,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,923 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:11,924 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138
2015-03-13 10:34:12,088 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:12,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138
2015-03-13 10:34:12,161 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:34:12,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,162 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0011
2015-03-13 10:34:12,162 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:34:12,162 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0011, with delay of 10800 seconds
2015-03-13 10:34:12,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004.tokens
2015-03-13 10:34:12,202 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:12,306 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:12,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0012_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003.tokens
2015-03-13 10:34:12,455 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:12,516 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,568 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:12,682 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005.tokens
2015-03-13 10:34:12,683 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:12,732 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138
2015-03-13 10:34:12,847 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,847 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,847 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,848 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,849 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,849 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,849 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,850 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,519 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,855 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,855 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,855 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,856 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,522 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,857 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,861 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:17,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:17,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:17,530 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53420, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 177000
2015-03-13 10:34:17,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split dst=null perm=null
2015-03-13 10:34:17,630 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53421, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 164000
2015-03-13 10:34:17,658 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53423, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 206000
2015-03-13 10:34:17,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:17,698 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53420, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 166000
2015-03-13 10:34:17,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53424, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 150000
2015-03-13 10:34:17,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:17,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:17,758 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53425, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 174000
2015-03-13 10:34:17,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt dst=null perm=null
2015-03-13 10:34:17,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53426, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 150000
2015-03-13 10:34:17,866 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:18,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53427, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1156000
2015-03-13 10:34:18,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:18,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,155 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:34:18,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:18,187 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:18,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139 src: /127.0.0.1:53428 dest: /127.0.0.1:52454
2015-03-13 10:34:18,230 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139 src: /127.0.0.1:53430 dest: /127.0.0.1:52444
2015-03-13 10:34:18,231 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139 src: /127.0.0.1:53431 dest: /127.0.0.1:52447
2015-03-13 10:34:18,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140 src: /127.0.0.1:53429 dest: /127.0.0.1:52447
2015-03-13 10:34:18,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140 src: /127.0.0.1:53432 dest: /127.0.0.1:52451
2015-03-13 10:34:18,238 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140 src: /127.0.0.1:53433 dest: /127.0.0.1:52454
2015-03-13 10:34:18,241 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53431, dest: /127.0.0.1:52447, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 9129000
2015-03-13 10:34:18,242 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,242 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:34:18,242 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53430, dest: /127.0.0.1:52444, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 9819000
2015-03-13 10:34:18,242 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,243 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:34:18,243 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53428, dest: /127.0.0.1:52454, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 10627000
2015-03-13 10:34:18,243 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,244 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:34:18,248 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1
2015-03-13 10:34:18,248 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53433, dest: /127.0.0.1:52454, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 8710000
2015-03-13 10:34:18,249 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,249 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,249 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53432, dest: /127.0.0.1:52451, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 8460000
2015-03-13 10:34:18,249 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,250 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,250 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53429, dest: /127.0.0.1:52447, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 9272000
2015-03-13 10:34:18,250 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,251 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,255 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1
2015-03-13 10:34:18,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003 dst=null perm=null
2015-03-13 10:34:18,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001 dst=null perm=null
2015-03-13 10:34:18,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000003_0 dst=null perm=null
2015-03-13 10:34:18,341 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:18,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000001_0 dst=null perm=null
2015-03-13 10:34:18,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:18,370 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000005
2015-03-13 10:34:18,370 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:18,370 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,370 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000005
2015-03-13 10:34:18,370 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,383 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000005 is : 143
2015-03-13 10:34:18,385 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:34:18,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142 src: /127.0.0.1:53435 dest: /127.0.0.1:52447
2015-03-13 10:34:18,389 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142 src: /127.0.0.1:53436 dest: /127.0.0.1:52451
2015-03-13 10:34:18,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142 src: /127.0.0.1:53437 dest: /127.0.0.1:52444
2015-03-13 10:34:18,394 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist for DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:18,397 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,398 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:18,399 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,399 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000005 from application application_1426267835672_0012
2015-03-13 10:34:18,399 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,399 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:18,400 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141 src: /127.0.0.1:53434 dest: /127.0.0.1:52447
2015-03-13 10:34:18,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141 src: /127.0.0.1:53438 dest: /127.0.0.1:52451
2015-03-13 10:34:18,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141 src: /127.0.0.1:53439 dest: /127.0.0.1:52454
2015-03-13 10:34:18,408 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000003
2015-03-13 10:34:18,409 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:18,409 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,409 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000003
2015-03-13 10:34:18,409 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,409 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:18,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000005
2015-03-13 10:34:18,411 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:18,411 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:34:18,411 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:18,411 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:34:18,411 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:34:18,411 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,411 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,411 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:34:18,411 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000005 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:34:18,413 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53439, dest: /127.0.0.1:52454, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 8103000
2015-03-13 10:34:18,413 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,414 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53438, dest: /127.0.0.1:52451, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 8908000
2015-03-13 10:34:18,414 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,414 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,415 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53434, dest: /127.0.0.1:52447, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 10354000
2015-03-13 10:34:18,415 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,417 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,418 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,423 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000003 is : 143
2015-03-13 10:34:18,427 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1
2015-03-13 10:34:18,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,436 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,437 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:18,437 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,437 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000003 from application application_1426267835672_0012
2015-03-13 10:34:18,437 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,437 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,437 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:18,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002 dst=null perm=null
2015-03-13 10:34:18,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,464 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:18,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000002_0 dst=null perm=null
2015-03-13 10:34:18,503 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000004
2015-03-13 10:34:18,503 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:18,503 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,504 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,504 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:18,504 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000003
2015-03-13 10:34:18,504 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,505 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000004
2015-03-13 10:34:18,505 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:18,505 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:34:18,505 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:18,505 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:34:18,505 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:34:18,506 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,506 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,506 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:34:18,506 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000003 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:34:18,520 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000004 is : 143
2015-03-13 10:34:18,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143 src: /127.0.0.1:53440 dest: /127.0.0.1:52447
2015-03-13 10:34:18,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143 src: /127.0.0.1:53441 dest: /127.0.0.1:52454
2015-03-13 10:34:18,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143 src: /127.0.0.1:53442 dest: /127.0.0.1:52451
2015-03-13 10:34:18,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,533 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,535 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,535 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:18,535 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,535 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000004 from application application_1426267835672_0012
2015-03-13 10:34:18,536 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,536 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:18,537 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53442, dest: /127.0.0.1:52451, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 6945000
2015-03-13 10:34:18,537 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,538 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:18,538 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53441, dest: /127.0.0.1:52454, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 7791000
2015-03-13 10:34:18,538 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,538 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:18,539 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53440, dest: /127.0.0.1:52447, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 8871000
2015-03-13 10:34:18,539 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,539 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:18,545 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1
2015-03-13 10:34:18,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000 dst=null perm=null
2015-03-13 10:34:18,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000000_0 dst=null perm=null
2015-03-13 10:34:18,605 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000002
2015-03-13 10:34:18,606 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:18,606 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,606 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000002
2015-03-13 10:34:18,606 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,606 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:18,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000004
2015-03-13 10:34:18,607 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:18,607 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:34:18,607 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:18,607 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:34:18,607 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:34:18,607 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,608 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,608 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:34:18,608 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000004 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:34:18,616 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000002 is : 143
2015-03-13 10:34:18,624 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,626 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:18,626 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,627 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000002 from application application_1426267835672_0012
2015-03-13 10:34:18,627 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,628 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:19,536 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:19,612 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:19,612 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000002
2015-03-13 10:34:19,612 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:19,613 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:34:19,613 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:19,613 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:34:19,613 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:34:19,613 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:19,613 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:19,614 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:34:19,614 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000002 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:20,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:20,193 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:20,193 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:34:20,194 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0012_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:20,194 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:34:20,194 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:20,537 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:20,750 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:20,761 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:20,763 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000006 by user soberoi
2015-03-13 10:34:20,763 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0012
2015-03-13 10:34:20,764 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:20,764 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from NEW to INITING
2015-03-13 10:34:20,764 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000006 to application application_1426267835672_0012
2015-03-13 10:34:20,764 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from INITING to RUNNING
2015-03-13 10:34:20,764 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:34:20,764 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:20,764 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:20,765 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:20,765 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:20,765 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:34:20,765 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:34:20,765 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000006
2015-03-13 10:34:20,775 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0012_01_000006.tokens. Credentials list:
2015-03-13 10:34:20,796 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:20,879 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0012_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006.tokens
2015-03-13 10:34:20,879 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:20,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:20,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:20,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar dst=null perm=null
2015-03-13 10:34:20,961 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53446, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_791227813_6267, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 475000
2015-03-13 10:34:20,986 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:21,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:21,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:21,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml dst=null perm=null
2015-03-13 10:34:21,011 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53447, bytes: 99586, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_791227813_6267, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 324000
2015-03-13 10:34:21,025 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:21,025 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:21,051 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:21,051 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:21,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006/default_container_executor.sh]
2015-03-13 10:34:21,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:21,193 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:21,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:21,756 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:34:21,935 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141
2015-03-13 10:34:21,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139
2015-03-13 10:34:21,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140
2015-03-13 10:34:21,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143
2015-03-13 10:34:22,109 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140
2015-03-13 10:34:22,109 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139
2015-03-13 10:34:22,109 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141
2015-03-13 10:34:22,110 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143
2015-03-13 10:34:22,155 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141
2015-03-13 10:34:22,156 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143
2015-03-13 10:34:22,156 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140
2015-03-13 10:34:22,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:22,543 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:22,742 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139
2015-03-13 10:34:23,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:23,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,545 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0012_r_000000_0_-1942593888_1
2015-03-13 10:34:23,548 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:23,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0 dst=null perm=null
2015-03-13 10:34:23,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0 dst=null perm=null
2015-03-13 10:34:23,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000 dst=null perm=null
2015-03-13 10:34:23,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:23,570 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000006
2015-03-13 10:34:23,571 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:23,571 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:34:23,571 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000006
2015-03-13 10:34:23,571 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:23,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,577 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1 dst=null perm=null
2015-03-13 10:34:23,581 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000006 is : 143
2015-03-13 10:34:23,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:23,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:23,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000 dst=null perm=null
2015-03-13 10:34:23,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000 dst=null perm=null
2015-03-13 10:34:23,590 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:23,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,590 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,591 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,590 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:23,591 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:23,591 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000006 from application application_1426267835672_0012
2015-03-13 10:34:23,591 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:23,591 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:23,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary dst=null perm=null
2015-03-13 10:34:23,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,601 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,604 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,617 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53437, dest: /127.0.0.1:52444, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 5224572000
2015-03-13 10:34:23,617 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,618 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:23,618 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53436, dest: /127.0.0.1:52451, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 5225794000
2015-03-13 10:34:23,618 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,619 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:23,619 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53435, dest: /127.0.0.1:52447, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 5227057000
2015-03-13 10:34:23,620 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,620 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:23,621 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,625 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:23,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144 src: /127.0.0.1:53452 dest: /127.0.0.1:52451
2015-03-13 10:34:23,629 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144 src: /127.0.0.1:53453 dest: /127.0.0.1:52444
2015-03-13 10:34:23,630 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144 src: /127.0.0.1:53454 dest: /127.0.0.1:52454
2015-03-13 10:34:23,632 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53454, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, duration: 1301000
2015-03-13 10:34:23,633 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,633 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,633 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53453, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, duration: 1783000
2015-03-13 10:34:23,633 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,634 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,634 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53452, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, duration: 2760000
2015-03-13 10:34:23,634 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,635 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,636 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist dst=null perm=null
2015-03-13 10:34:23,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:34:23,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist dst=null perm=null
2015-03-13 10:34:23,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:34:23,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist dst=null perm=null
2015-03-13 10:34:23,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,652 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53455, bytes: 58234, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 214000
2015-03-13 10:34:23,654 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:23,655 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145 src: /127.0.0.1:53456 dest: /127.0.0.1:52454
2015-03-13 10:34:23,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145 src: /127.0.0.1:53457 dest: /127.0.0.1:52447
2015-03-13 10:34:23,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145 src: /127.0.0.1:53458 dest: /127.0.0.1:52451
2015-03-13 10:34:23,660 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53458, dest: /127.0.0.1:52451, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, duration: 1705000
2015-03-13 10:34:23,660 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,660 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:23,660 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53457, dest: /127.0.0.1:52447, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, duration: 2245000
2015-03-13 10:34:23,661 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:23,661 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53456, dest: /127.0.0.1:52454, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, duration: 2993000
2015-03-13 10:34:23,661 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,662 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:23,663 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml dst=null perm=null
2015-03-13 10:34:23,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp dst=null perm=null
2015-03-13 10:34:23,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml dst=null perm=null
2015-03-13 10:34:23,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp dst=null perm=null
2015-03-13 10:34:23,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml dst=null perm=null
2015-03-13 10:34:23,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53459, bytes: 92125, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 304000
2015-03-13 10:34:23,677 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:23,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146 src: /127.0.0.1:53460 dest: /127.0.0.1:52447
2015-03-13 10:34:23,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146 src: /127.0.0.1:53461 dest: /127.0.0.1:52444
2015-03-13 10:34:23,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146 src: /127.0.0.1:53462 dest: /127.0.0.1:52454
2015-03-13 10:34:23,684 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53462, dest: /127.0.0.1:52454, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, duration: 1747000
2015-03-13 10:34:23,685 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,685 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,685 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53461, dest: /127.0.0.1:52444, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, duration: 2208000
2015-03-13 10:34:23,685 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,686 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,686 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53460, dest: /127.0.0.1:52447, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, duration: 2978000
2015-03-13 10:34:23,686 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,686 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,688 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,701 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from RUNNING to FINISHING
2015-03-13 10:34:23,701 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0012
2015-03-13 10:34:23,701 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from RUNNING to REMOVING
2015-03-13 10:34:23,701 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0012
2015-03-13 10:34:23,702 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from REMOVING to FINISHING
2015-03-13 10:34:24,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:24,572 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:24,572 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000006
2015-03-13 10:34:24,573 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:24,573 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:34:24,573 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426267835672_0012 CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:24,573 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:34:24,573 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:34:24,574 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:24,574 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:24,574 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:34:24,574 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000006 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:24,713 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741958_1134 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447
2015-03-13 10:34:24,713 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741959_1135 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444
2015-03-13 10:34:24,713 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741960_1136 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454
2015-03-13 10:34:24,714 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741961_1137 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454
2015-03-13 10:34:24,714 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741966_1142 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444
2015-03-13 10:34:24,714 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741962_1138 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454
2015-03-13 10:34:24,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012 dst=null perm=null
2015-03-13 10:34:24,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,742 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary
2015-03-13 10:34:24,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary dst=null perm=null
2015-03-13 10:34:24,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,744 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary
2015-03-13 10:34:24,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:24,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:24,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,746 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary
2015-03-13 10:34:24,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary dst=null perm=null
2015-03-13 10:34:24,753 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:24,754 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:24,754 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:24,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,757 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:34:24,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000 dst=null perm=null
2015-03-13 10:34:24,764 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:24,764 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:24,765 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:24,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,768 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:34:24,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:34:24,771 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53464, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 167000
2015-03-13 10:34:24,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:34:24,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53464, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 154000
2015-03-13 10:34:24,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:34:24,775 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53465, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 177000
2015-03-13 10:34:24,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:34:24,777 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53465, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 167000
2015-03-13 10:34:24,777 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allseq/trap
2015-03-13 10:34:24,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap dst=null perm=null
2015-03-13 10:34:24,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:34:24,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000 dst=null perm=null
2015-03-13 10:34:24,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53464, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 175000
2015-03-13 10:34:24,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:34:24,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001 dst=null perm=null
2015-03-13 10:34:24,785 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53466, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 176000
2015-03-13 10:34:24,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:34:24,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002 dst=null perm=null
2015-03-13 10:34:24,788 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53466, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 162000
2015-03-13 10:34:24,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:34:24,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003 dst=null perm=null
2015-03-13 10:34:24,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53465, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 131000
2015-03-13 10:34:24,791 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allseq/tap
2015-03-13 10:34:24,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap dst=null perm=null
2015-03-13 10:34:24,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000 dst=null perm=null
2015-03-13 10:34:24,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000 dst=null perm=null